00000001:02000400:3.0F:1788587593.995169:0:2957:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg633-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788587608.654955:0:3179:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg633-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788587610.168563:0:3237:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 679 MB/s 00000001:01000000:1.0F:1788587610.418491:0:3237:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1051 MB/s 00000001:01000000:3.0:1788587610.668114:0:3237:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8023 MB/s 00000020:02000000:3.0:1788587611.301789:0:3270:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g97ad22e 00000400:02000000:3.0:1788587612.039039:0:3285:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.133@tcp [8/256/0/180] 00008000:02000000:3.0:1788587615.438171:0:3435:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788587660.387310:0:5243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg633-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788587668.818362:0:5821:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788587668.818371:0:5821:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788587668.818504:0:5821:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000030cec0d5 00000080:02000400:1.0:1788587668.818519:0:5821:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788587668.837418:0:5821:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788587668.837436:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788587668.837499:0:5821:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002f8ca3dc) 00000020:00000080:1.0:1788587668.837525:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788587668.890968:0:5821:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788587668.891638:0:5821:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788587668.923519:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788587668.923565:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788587668.923589:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788587668.923643:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788587668.923672:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788587668.925727:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788587668.925740:0:5821:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788587668.925756:0:5821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13e120d54ca7f68 00000020:01000004:3.0:1788587668.925765:0:5821:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788587668.925771:0:5821:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788587668.925777:0:5821:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000030cec0d5 from MGS 00000020:01000004:3.0:1788587668.925782:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788587668.925820:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000007c1c0a82) 00000020:00000080:3.0:1788587668.925836:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788587668.926039:0:5821:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000030cec0d5 from MGS, refs=2 00080000:01000000:3.0:1788587668.926045:0:5821:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788587668.926051:0:5821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13e120d54ca7f76 00000100:00100000:3.0:1788587668.926400:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788587668.926564:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788587668.926570:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788587668.927984:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788587668.927996:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788587668.928762:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587668.928977:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788587668.928982:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788587668.929544:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788587668.929552:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788587668.929953:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788587668.929965:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0F:1788587668.930566:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587668.930574:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587668.930576:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587668.930862:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587668.930865:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587668.930866:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587668.931639:0:5821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788587668.934157:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788587669.181120:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3203 MB/s 00000001:01000000:2.0:1788587669.430908:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4547 MB/s 00000001:01000000:2.0:1788587669.681766:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 775 MB/s 00000001:01000000:3.0:1788587669.932033:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 747 MB/s 00080000:10000000:1.0:1788587669.944113:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1788587669.960178:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788587669.962707:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788587669.962722:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788587669.962724:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788587669.963761:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788587669.968007:0:5821:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788587669.968076:0:5821:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788587669.968377:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788587669.968408:0:5821:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788587669.968797:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587669.969039:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788587669.969047:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788587669.977307:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788587669.977332:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788587669.979253:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788587669.979267:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788587669.983692:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788587669.983732:0:5821:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.133@tcp' 00000020:01000004:1.0:1788587669.983736:0:5821:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788587669.983808:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.133@tcp (typ=mgc) 00000020:00000080:1.0:1788587669.983823:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.133@tcp (00000000082610c0) 00000100:00080000:2.0:1788587669.984068:0:5837:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788587669.984385:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788587669.984514:0:5821:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000077430f8c@MGC192.168.206.133@tcp: add connection 192.168.206.133@tcp at head 00010000:00010000:1.0:1788587669.984753:0:5821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.133@tcp-0 is initialized 00000040:01000000:1.0:1788587669.984766:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.133@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788587669.988942:0:5838:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788587669.989016:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.133@tcp (uuid 52de7536-38dc-49e6-9b51-4cdaba805a7b) 00000020:00000080:1.0:1788587669.989056:0:5821:0:(genops.c:1385:class_connect()) connect: client 52de7536-38dc-49e6-9b51-4cdaba805a7b, cookie 0xa13e120d54ca7f84 00000100:00080000:1.0:1788587669.989071:0:5821:0:(import.c:545:import_select_connection()) MGC192.168.206.133@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587669.989078:0:5821:0:(import.c:665:import_select_connection()) MGC192.168.206.133@tcp: import 0000000077430f8c using connection 192.168.206.133@tcp/0@lo 00000100:00100000:1.0:1788587669.989128:0:5821:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000df46fa5 x1875470043840640/t0(0) o250->MGC192.168.206.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587669.989158:0:5821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 52de7536-38dc-49e6-9b51-4cdaba805a7b->MGS 00000020:01000004:1.0:1788587669.989184:0:5821:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788587669.989190:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788587669.989205:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006553b4c4) 00000020:00000080:1.0:1788587669.989216:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788587669.993791:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000df46fa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:52de7536-38dc-49e6-9b51-4cdaba805a7b:3301:1875470043840640:0@lo:250: 00000100:00100000:2.0:1788587669.993962:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587669.996146:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043840640 00000100:00100000:3.0:1788587669.996164:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043840640 00000100:00100000:3.0:1788587669.996205:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587669.996213:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd3edff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1875470043840640:12345-0@lo:250: 00010000:00080000:3.0:1788587669.996245:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 52de7536-38dc-49e6-9b51-4cdaba805a7b@0@lo t0 exp 0000000000000000 cur 117 last 0 00000020:00000080:3.0:1788587669.996277:0:5834:0:(genops.c:1385:class_connect()) connect: client 52de7536-38dc-49e6-9b51-4cdaba805a7b, cookie 0xa13e120d54ca7f92 00000100:00080000:3.0:1788587669.996426:0:5834:0:(import.c:65:import_set_state_nolock()) 00000000140225b9 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587669.996572:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd3edff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+5:3301:x1875470043840640:12345-0@lo:250: Request processed in 358us (2613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587669.996581:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587669.998778:0:3301:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.133@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788587669.998795:0:3301:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.206.133@tcp: connect to target with instance 0 00000100:00080000:3.0:1788587669.998803:0:3301:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.206.133@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788587669.998809:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788587669.998813:0:3301:0:(import.c:65:import_set_state_nolock()) 0000000077430f8c MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788587669.998818:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788587669.998821:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788587669.998829:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000df46fa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:52de7536-38dc-49e6-9b51-4cdaba805a7b:3301:1875470043840640:0@lo:250: 00000100:00100000:3.0:1788587670.012349:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587670.012565:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788587670.012572:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788587670.013670:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788587670.013692:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788587670.015175:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788587670.015191:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788587670.017126:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587670.017382:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788587670.017389:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788587670.018719:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788587670.018729:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788587670.070514:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587670.071159:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788587670.071167:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788587670.073049:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788587670.073061:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788587670.073811:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587670.074221:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788587670.074227:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788587670.074813:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788587670.074827:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788587670.077224:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587670.077385:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788587670.077391:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788587670.083432:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788587670.083446:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788587670.084489:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587670.084784:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788587670.084791:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788587670.086397:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788587670.086408:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788587670.113063:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587670.113288:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788587670.113294:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788587670.115129:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788587670.115284:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788587670.116932:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788587670.117061:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788587670.118198:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788587670.118292:0:5821:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788587670.118299:0:5821:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.133@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788587670.118430:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.133@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788587670.119339:0:5821:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.133@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788587670.119345:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788587670.119347:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788587670.119349:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587670.119350:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587670.119351:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587670.119352:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587670.119353:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587670.119354:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788587670.119356:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788587670.119357:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788587670.119358:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587670.119359:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788587670.119361:0:5821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788587670.119364:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587670.119365:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788587670.119365:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587670.119366:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587670.119367:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587670.119368:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587670.119369:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587670.119370:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788587670.119370:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788587670.119371:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788587670.119372:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587670.119373:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788587670.119407:0:5821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788587670.119424:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4fcf680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043840768:0@lo:253: 00000100:00100000:3.0:1788587670.119506:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587670.119608:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e30ba0e going to sleep for 11 seconds 00000100:00100000:2.0:1788587670.119693:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043840768 00000100:00100000:2.0:1788587670.119706:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043840768 00000100:00100000:2.0:1788587670.120182:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587670.120191:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a2601c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+5:5821:x1875470043840768:12345-0@lo:253: 20000000:01000000:2.0:1788587670.120233:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788587670.120237:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788587670.120569:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788587670.120633:0:5836:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788587670.120944:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587670.122299:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788587670.122513:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788587670.122518:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788587670.122523:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788587670.122526:0:5836:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788587670.122541:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788587670.122709:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587670.123133:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788587670.123145:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788587670.123189:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788587670.123233:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788587670.123267:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788587670.123346:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788587670.123355:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788587670.123395:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788587670.123403:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788587670.123434:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788587670.123442:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788587670.123487:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788587670.123538:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788587670.123570:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788587670.123575:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788587670.123588:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587670.126194:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788587670.126219:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788587670.126273:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788587670.126316:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788587670.126360:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788587670.126375:0:5836:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788587670.126497:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788587670.126506:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788587670.126552:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788587670.126590:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788587670.126622:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788587670.126633:0:5836:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788587670.126718:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788587670.126727:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788587670.126758:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788587670.126793:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788587670.127334:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788587670.127390:0:5836:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788587670.127397:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788587670.128186:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788587670.128477:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788587670.128501:0:5836:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.133@tcp for mdt 20000000:01000000:2.0:1788587670.128503:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.133@tcp (null) (null) (null) 00000040:00080000:2.0:1788587670.128537:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788587670.128546:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788587670.128576:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788587670.128582:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.133@tcp (null) (null) 00000040:00080000:2.0:1788587670.128622:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788587670.128631:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788587670.128663:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788587670.128693:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788587670.129083:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788587670.129087:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788587670.129091:0:5836:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788587670.129104:0:5836:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788587670.129576:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1788587670.129704:0:5836:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788587670.139539:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788587670.139586:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788587670.139655:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788587670.139673:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788587670.139676:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788587670.139679:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788587670.139710:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788587670.139717:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788587670.140623:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788587670.140627:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788587670.141714:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1788587670.142253:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1788587670.142320:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1788587670.142391:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1788587670.142406:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788587670.142408:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788587670.143693:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788587670.144377:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788587670.144427:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788587670.144478:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788587670.144492:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788587670.144495:0:5836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1788587670.144501:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788587670.144520:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000010d504aa/0xa13e120d54ca7f99 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587670.144536:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010d504aa/0xa13e120d54ca7f99 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587670.144544:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010d504aa/0xa13e120d54ca7f99 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587670.144549:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010d504aa/0xa13e120d54ca7f99 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587670.144555:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000010d504aa/0xa13e120d54ca7f99 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587670.144561:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000010d504aa/0xa13e120d54ca7f99 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587670.144566:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000010d504aa already unused, calling callback (00000000e8289bfc) 00010000:00010000:2.0:1788587670.144569:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000010d504aa/0xa13e120d54ca7f99 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587670.144589:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000010d504aa/0xa13e120d54ca7f99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587670.144601:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000010d504aa/0xa13e120d54ca7f99 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587670.144608:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000010d504aa/0xa13e120d54ca7f99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587670.144613:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000010d504aa/0xa13e120d54ca7f99 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788587670.144628:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788587670.310521:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a2601c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+5:5821:x1875470043840768:12345-0@lo:253: Request processed in 190325us (191008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587670.310536:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587670.310653:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4fcf680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043840768:0@lo:253: 10000000:01000000:3.0:1788587670.310667:0:5821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788587670.310670:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788587670.310672:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788587670.310673:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587670.310674:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788587670.310675:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587670.310676:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587670.310677:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587670.310678:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788587670.310679:0:5821:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788587670.310681:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587670.310682:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788587670.310698:0:5821:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000030cec0d5 from lustre-MDT0000 10000000:01000000:3.0:1788587670.310722:0:5821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788587670.310724:0:5821:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788587670.310728:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88f48709cd40 10000000:01000000:3.0:1788587670.310732:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587670.310740:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88f48709cd40 from 1 10000000:01000000:3.0:1788587670.310742:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788587670.310774:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.310783:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.310816:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587670.310835:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4fcf680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043840896:0@lo:101: 00000100:00100000:3.0:1788587670.310910:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587670.310962:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000791060d0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587670.311054:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043840896 00000100:00100000:0.0:1788587670.311061:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043840896 00000100:00100000:0.0:1788587670.311128:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587670.311137:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9a93492 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+5:5821:x1875470043840896:12345-0@lo:101: 00010000:00010000:0.0:1788587670.311150:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587670.311163:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c59ce78/0xa13e120d54ca7fa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca7fa0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.311185:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c59ce78/0xa13e120d54ca7fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca7fa0 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.311194:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c59ce78/0xa13e120d54ca7fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca7fa0 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.311202:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c59ce78, rc 0) 00000100:00100000:0.0:1788587670.311245:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9a93492 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+6:5821:x1875470043840896:12345-0@lo:101: Request processed in 110us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587670.311261:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587670.311348:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4fcf680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043840896:0@lo:101: 00010000:00010000:3.0:1788587670.311360:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca7fa7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.311368:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca7fa7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587670.311422:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4fcf680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043841024:0@lo:501: 00000100:00100000:3.0:1788587670.311448:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587670.311472:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000791060d0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587670.311531:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043841024 00000100:00100000:2.0:1788587670.311535:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043841024 00000100:00100000:2.0:1788587670.311567:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587670.311573:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c5525f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+6:5821:x1875470043841024:12345-0@lo:501: 00000100:00100000:2.0:1788587670.311785:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c5525f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+6:5821:x1875470043841024:12345-0@lo:501: Request processed in 213us (337us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788587670.311792:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587670.312254:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4fcf680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043841024:0@lo:501: 10000000:01000000:0.0:1788587670.312387:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788587670.312403:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca7fa7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.312411:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca7fa7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587670.312417:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88f488106000 10000000:01000000:0.0:1788587670.312421:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788587670.312424:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88f488106000 10000000:01000000:0.0:1788587670.312427:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788587670.312429:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88f488106000 from 1 10000000:01000000:0.0:1788587670.312432:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788587670.312472:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: 000000001fdc5f0e/0xa13e120d54ca7fae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.312479:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: 000000001fdc5f0e/0xa13e120d54ca7fae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.312485:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: 000000001fdc5f0e/0xa13e120d54ca7fae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587670.312498:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001bfc05f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043841152:0@lo:101: 00000100:00100000:0.0:1788587670.312528:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587670.312559:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcedb3ca going to sleep for 11 seconds 00000100:00100000:3.0:1788587670.312617:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043841152 00000100:00100000:3.0:1788587670.312622:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043841152 00000100:00100000:3.0:1788587670.312655:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587670.312662:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000628077a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+6:5821:x1875470043841152:12345-0@lo:101: 00010000:00010000:3.0:1788587670.312670:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587670.312680:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dad22d7e/0xa13e120d54ca7fb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca7fae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.312695:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dad22d7e/0xa13e120d54ca7fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca7fae expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.312715:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dad22d7e/0xa13e120d54ca7fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca7fae expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.312721:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dad22d7e, rc 0) 00000100:00100000:3.0:1788587670.312762:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000628077a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+7:5821:x1875470043841152:12345-0@lo:101: Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587670.312768:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587670.313056:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001bfc05f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043841152:0@lo:101: 00010000:00010000:1.0:1788587670.313068:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: 000000001fdc5f0e/0xa13e120d54ca7fae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587670.313076:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: 000000001fdc5f0e/0xa13e120d54ca7fae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587670.313086:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788587670.313113:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: 000000001fdc5f0e/0xa13e120d54ca7fae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587670.313120:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: 000000001fdc5f0e/0xa13e120d54ca7fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587670.313126:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788587670.313130:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788587670.313134:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88f488106000 10000000:01000000:1.0:1788587670.313136:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788587670.313138:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788587670.313141:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788587670.313156:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587670.313162:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587670.313168:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587670.313180:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f6a3030e pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043841280:0@lo:101: 00000100:00100000:1.0:1788587670.313207:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587670.313233:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d10f302e going to sleep for 11 seconds 00000100:00100000:3.0:1788587670.313304:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043841280 00000100:00100000:3.0:1788587670.313309:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043841280 00000100:00100000:3.0:1788587670.313339:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587670.313345:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000274372e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+7:5821:x1875470043841280:12345-0@lo:101: 00010000:00010000:3.0:1788587670.313352:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587670.313359:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000090932df0/0xa13e120d54ca7fc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca7fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.313372:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000090932df0/0xa13e120d54ca7fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca7fbc expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.313379:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000090932df0/0xa13e120d54ca7fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca7fbc expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.313385:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000090932df0, rc 0) 00000100:00100000:3.0:1788587670.313421:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000274372e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+8:5821:x1875470043841280:12345-0@lo:101: Request processed in 77us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587670.313427:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587670.313538:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f6a3030e pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043841280:0@lo:101: 00010000:00010000:1.0:1788587670.313548:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca7fc3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587670.313555:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca7fc3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587670.313602:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f6a3030e pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043841408:0@lo:501: 00000100:00100000:1.0:1788587670.313625:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587670.313684:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d10f302e going to sleep for 11 seconds 00000100:00100000:0.0:1788587670.314507:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043841408 00000100:00100000:0.0:1788587670.314521:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043841408 00000100:00100000:1.0:1788587670.316674:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587670.316685:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bccefaa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+8:5821:x1875470043841408:12345-0@lo:501: 00000100:00100000:1.0:1788587670.317014:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bccefaa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:5821:x1875470043841408:12345-0@lo:501: Request processed in 330us (3388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587670.317023:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587670.317381:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f6a3030e pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043841408:0@lo:501: 00000100:00100000:0.0:1788587670.317427:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043841536:0@lo:503: 00000100:00100000:0.0:1788587670.317484:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587670.317536:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000005e2dc298 going to sleep for 11 seconds 00000100:00100000:3.0:1788587670.317649:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043841536 00000100:00100000:3.0:1788587670.317656:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043841536 00000100:00100000:3.0:1788587670.317687:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587670.317703:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e500fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:5821:x1875470043841536:12345-0@lo:503: 00000100:00100000:3.0:1788587670.318013:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e500fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:5821:x1875470043841536:12345-0@lo:503: Request processed in 311us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587670.318020:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587670.318114:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043841536:0@lo:503: 00000100:00100000:3.0:1788587670.318971:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030ae7ac4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:5864:1875470043841664:0@lo:502: 00000100:00100000:3.0:1788587670.319014:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587670.319046:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4c85e55 going to sleep for 11 seconds 00000100:00100000:2.0:1788587670.319071:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043841664 00000100:00100000:2.0:1788587670.319078:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043841664 00000100:00100000:2.0:1788587670.319112:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587670.319120:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000caf1385 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:5864:x1875470043841664:12345-0@lo:502: 00000100:00100000:2.0:1788587670.319309:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000caf1385 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:5864:x1875470043841664:12345-0@lo:502: Request processed in 190us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587670.319321:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587670.319418:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030ae7ac4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:5864:1875470043841664:0@lo:502: 00000020:01000000:0.0:1788587670.319441:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587670.319466:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587670.319469:0:5864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788587670.319477:0:5864:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788587670.319481:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788587670.319502:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000af1716d7) 00000020:00000080:0.0:1788587670.319518:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788587670.319524:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788587670.319646:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788587670.319653:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13e120d54ca7fd1 00000020:00000080:0.0:1788587670.319892:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788587670.319897:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587670.319900:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587670.319902:0:5864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788587670.319904:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587670.319908:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587670.319909:0:5864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788587670.319912:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788587670.319918:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a69c63d4) 00000020:00000080:0.0:1788587670.319928:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788587670.319932:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788587670.319934:0:5864:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788587670.319936:0:5864:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788587670.319962:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788587670.320005:0:5864:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000030cec0d5 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788587670.320016:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000cb9df259) 00000020:00000080:0.0:1788587670.320025:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788587670.320086:0:5864:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788587670.320096:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13e120d54ca7fe6 00000020:00000080:0.0:1788587670.320181:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788587670.320187:0:5864:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788587670.320191:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa13e120d54ca7fed 00080000:01000000:0.0:1788587670.320196:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788587670.320200:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13e120d54ca7ff4 00080000:10000000:0.0:1788587670.320605:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788587670.320797:0:5864:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788587670.325080:0:5864:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788587670.380055:0:5864:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788587670.380338:0:5864:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788587670.382885:0:5864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788587670.383466:0:5864:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788587670.416812:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000db471f8c) 00000020:00000080:0.0:1788587670.416834:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788587670.419016:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788587670.419031:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13e120d54ca8002 00000020:00000080:1.0:1788587670.419627:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788587670.421257:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587670.455760:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587670.479764:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587670.512785:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587670.547213:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587670.573408:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788587670.610820:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa13e120d54ca8009 00000020:00000080:2.0:1788587670.611215:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788587670.611225:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587670.611231:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587670.611232:0:5864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788587670.611235:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587670.611241:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587670.611242:0:5864:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788587670.611246:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788587670.611279:0:5864:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788587670.611293:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587670.611297:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587670.611298:0:5864:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788587670.611300:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587670.611303:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587670.611304:0:5864:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788587670.611306:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788587670.611308:0:5864:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788587670.611356:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e6c537c5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:5864:1875470043841792:0@lo:502: 00000100:00100000:2.0:1788587670.611429:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587670.611489:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 00000000584abc41 going to sleep for 11 seconds 00000100:00100000:2.0:1788587670.611511:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043841792 00000100:00100000:2.0:1788587670.611517:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043841792 00000100:00100000:2.0:1788587670.611552:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587670.611559:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b92f0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:5864:x1875470043841792:12345-0@lo:502: 00000100:00100000:2.0:1788587670.612176:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b92f0d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:5864:x1875470043841792:12345-0@lo:502: Request processed in 615us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587670.612185:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587670.612256:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e6c537c5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:5864:1875470043841792:0@lo:502: 00000020:01000000:3.0:1788587670.612283:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587670.612287:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587670.612289:0:5864:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788587670.612292:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788587670.612568:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788587670.612587:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788587670.612641:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca7fc3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.612652:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca7fc3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587670.612667:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88f488106000 from 1 10000000:01000000:0.0:1788587670.612670:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788587670.612698:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.612705:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.612713:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587670.612726:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043841920:0@lo:101: 00000100:00100000:0.0:1788587670.612756:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587670.612791:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000003678a08a going to sleep for 11 seconds 00000100:00100000:1.0:1788587670.612871:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043841920 00000100:00100000:1.0:1788587670.612877:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043841920 00000100:00100000:1.0:1788587670.612906:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788587670.612912:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c1d2505 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:5821:x1875470043841920:12345-0@lo:101: 00010000:00010000:1.0:1788587670.612922:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587670.612934:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef2ed611/0xa13e120d54ca8017 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8010 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587670.612964:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef2ed611/0xa13e120d54ca8017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8010 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587670.612973:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef2ed611/0xa13e120d54ca8017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8010 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587670.612992:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef2ed611, rc 0) 00000100:00100000:1.0:1788587670.613031:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c1d2505 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:5821:x1875470043841920:12345-0@lo:101: Request processed in 119us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587670.613036:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587670.613107:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043841920:0@lo:101: 00010000:00010000:0.0:1788587670.613118:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8017 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.613126:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca8017 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587670.613675:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043842048:0@lo:256: 00000100:00100000:0.0:1788587670.613713:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587670.613742:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000003678a08a going to sleep for 11 seconds 00000100:00100000:2.0:1788587670.613914:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043842048 00000100:00100000:2.0:1788587670.613924:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043842048 00000100:00100000:2.0:1788587670.613963:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587670.613968:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000081f3711 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:5821:x1875470043842048:12345-0@lo:256: 20000000:01000000:2.0:1788587670.613980:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788587670.613985:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788587670.614047:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000081f3711 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:5821:x1875470043842048:12345-0@lo:256: Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587670.614053:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587670.614196:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043842048:0@lo:256: 10000000:01000000:0.0:1788587670.614772:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788587670.614792:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8017 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.614808:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8017 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587670.614816:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f488106000 from 1 10000000:01000000:0.0:1788587670.614819:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587670.614838:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.615010:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.615018:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587670.615033:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043842176:0@lo:101: 00000100:00100000:0.0:1788587670.615067:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587670.615096:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000003678a08a going to sleep for 11 seconds 00000100:00100000:3.0:1788587670.615152:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043842176 00000100:00100000:3.0:1788587670.615158:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043842176 00000100:00100000:3.0:1788587670.615300:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587670.615308:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad2cc4ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:5821:x1875470043842176:12345-0@lo:101: 00010000:00010000:3.0:1788587670.615317:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587670.615328:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045226332/0xa13e120d54ca8025 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca801e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.615345:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045226332/0xa13e120d54ca8025 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca801e expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.615354:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045226332/0xa13e120d54ca8025 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca801e expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.615361:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045226332, rc 0) 00000100:00100000:3.0:1788587670.615403:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad2cc4ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5821:x1875470043842176:12345-0@lo:101: Request processed in 96us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587670.615410:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587670.615520:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043842176:0@lo:101: 00010000:00010000:0.0:1788587670.615531:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8025 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.615538:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca8025 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587670.615584:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043842304:0@lo:501: 00000100:00100000:0.0:1788587670.615608:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587670.615675:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000003678a08a going to sleep for 11 seconds 00000100:00100000:1.0:1788587670.615718:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043842304 00000100:00100000:1.0:1788587670.615722:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043842304 00000100:00100000:1.0:1788587670.615751:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587670.615756:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045bea9cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5821:x1875470043842304:12345-0@lo:501: 00000100:00100000:1.0:1788587670.616460:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045bea9cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5821:x1875470043842304:12345-0@lo:501: Request processed in 692us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587670.616468:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788587670.616549:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043842304:0@lo:501: 00000100:00100000:0.0:1788587670.616581:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043842432:0@lo:503: 00000100:00100000:0.0:1788587670.616616:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587670.616692:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000003678a08a going to sleep for 11 seconds 00000100:00100000:2.0:1788587670.616731:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043842432 00000100:00100000:2.0:1788587670.616736:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043842432 00000100:00100000:2.0:1788587670.616803:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587670.616811:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006197d340 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5821:x1875470043842432:12345-0@lo:503: 00000040:00080000:2.0:1788587670.616870:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788587670.616913:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006197d340 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5821:x1875470043842432:12345-0@lo:503: Request processed in 103us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587670.616920:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788587670.616993:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043842432:0@lo:503: 00000040:00080000:0.0:1788587670.617894:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788587670.618082:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788587670.618099:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587670.618119:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8025 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587670.618129:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8025 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587670.618170:0:5821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788587670.618173:0:5821:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88f488106000 10000000:01000000:1.0:1788587670.618176:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88f488106000 10000000:01000000:1.0:1788587670.618180:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788587670.618184:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88f488106000 from 1 10000000:01000000:1.0:1788587670.618187:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788587670.618209:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587670.618226:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587670.618234:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587670.618250:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cda9e5ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043842560:0@lo:101: 00000100:00100000:1.0:1788587670.618285:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587670.618457:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d10f302e going to sleep for 11 seconds 00000100:00100000:3.0:1788587670.618521:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043842560 00000100:00100000:3.0:1788587670.618527:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043842560 00000100:00100000:3.0:1788587670.618555:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587670.618561:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001ded035 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5821:x1875470043842560:12345-0@lo:101: 00010000:00010000:3.0:1788587670.618569:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587670.618580:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000057def9af/0xa13e120d54ca8033 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca802c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.618599:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000057def9af/0xa13e120d54ca8033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca802c expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.618607:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000057def9af/0xa13e120d54ca8033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca802c expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.618614:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000057def9af, rc 0) 00000100:00100000:3.0:1788587670.618686:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001ded035 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5821:x1875470043842560:12345-0@lo:101: Request processed in 125us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587670.618692:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788587670.618797:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cda9e5ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043842560:0@lo:101: 00010000:00010000:1.0:1788587670.618809:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8033 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587670.618817:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca8033 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587670.622137:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cda9e5ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043842688:0@lo:501: 00000100:00100000:1.0:1788587670.622198:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587670.622245:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d10f302e going to sleep for 11 seconds 00000100:00100000:3.0:1788587670.622308:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043842688 00000100:00100000:3.0:1788587670.622315:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043842688 00000100:00100000:3.0:1788587670.622362:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788587670.622369:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3c67fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5821:x1875470043842688:12345-0@lo:501: 00000100:00100000:3.0:1788587670.622612:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3c67fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5821:x1875470043842688:12345-0@lo:501: Request processed in 244us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587670.622620:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788587670.622697:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cda9e5ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043842688:0@lo:501: 00000100:00100000:1.0:1788587670.622729:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cda9e5ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043842816:0@lo:503: 00000100:00100000:1.0:1788587670.622764:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587670.622785:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d10f302e going to sleep for 11 seconds 00000100:00100000:3.0:1788587670.622826:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043842816 00000100:00100000:3.0:1788587670.622837:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043842816 00000100:00100000:3.0:1788587670.622889:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788587670.622895:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043ac671b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5821:x1875470043842816:12345-0@lo:503: 00000100:00100000:3.0:1788587670.623226:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043ac671b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5821:x1875470043842816:12345-0@lo:503: Request processed in 331us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587670.623234:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788587670.623325:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cda9e5ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043842816:0@lo:503: 00000100:00100000:1.0:1788587670.623649:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cda9e5ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:5869:1875470043842944:0@lo:502: 00000100:00100000:1.0:1788587670.623690:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587670.623719:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9d4c916 going to sleep for 11 seconds 00000100:00100000:0.0:1788587670.623777:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043842944 00000100:00100000:0.0:1788587670.623782:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043842944 00000100:00100000:0.0:1788587670.623815:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587670.623823:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044d7d803 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5869:x1875470043842944:12345-0@lo:502: 00000100:00100000:0.0:1788587670.624327:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044d7d803 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5869:x1875470043842944:12345-0@lo:502: Request processed in 505us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587670.624335:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788587670.624396:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cda9e5ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:5869:1875470043842944:0@lo:502: 00000020:01000004:1.0:1788587670.624459:0:5869:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788587670.624474:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000053c0aab3) 00000020:00000080:1.0:1788587670.624491:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788587670.624582:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000030cec0d5 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788587670.624586:0:5869:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000030cec0d5 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788587670.624588:0:5869:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000030cec0d5 4 00010000:00080000:1.0:1788587670.624613:0:5869:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dc7894ef@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.133@tcp at head 00010000:00010000:1.0:1788587670.626736:0:5869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788587670.627007:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788587670.627038:0:5869:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788587670.627048:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa13e120d54ca8041 00000100:00080000:1.0:1788587670.627057:0:5869:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587670.627062:0:5869:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000dc7894ef using connection 192.168.206.133@tcp/0@lo 00000100:00100000:1.0:1788587670.627092:0:5869:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cda9e5ad x1875470043843072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587670.627114:0:5869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788587670.627324:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cda9e5ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875470043843072:0@lo:38: 00000100:00100000:3.0:1788587670.627385:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587670.627564:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043843072 00000100:00100000:1.0:1788587670.627571:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043843072 00000100:00100000:1.0:1788587670.627611:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587670.627617:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004277bb3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875470043843072:12345-0@lo:38: 00000100:00100000:1.0:1788587670.627669:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004277bb3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875470043843072:12345-0@lo:38: Request processed in 50us (283us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788587670.627676:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587670.627733:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788587670.627740:0:3301:0:(import.c:65:import_set_state_nolock()) 00000000dc7894ef lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587670.627744:0:3301:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788587670.627746:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cda9e5ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875470043843072:0@lo:38: 00000100:00100000:1.0:1788587670.632660:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092b513f5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:5869:1875470043843200:0@lo:502: 00000100:00100000:1.0:1788587670.632750:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587670.632787:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043843200 00000100:00100000:1.0:1788587670.632793:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043843200 00000100:00100000:1.0:1788587670.632829:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788587670.632837:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f7a36a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5869:x1875470043843200:12345-0@lo:502: 00000100:00100000:1.0:1788587670.633274:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f7a36a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5869:x1875470043843200:12345-0@lo:502: Request processed in 438us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587670.633283:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788587670.633329:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 00000000706760c9 going to sleep for 11 seconds 00000100:00100000:1.0:1788587670.633349:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092b513f5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:5869:1875470043843200:0@lo:502: 00000040:00080000:1.0:1788587670.633372:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788587670.635618:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788587670.635647:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788587670.635666:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8033 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587670.635679:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8033 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788587670.635726:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788587670.635728:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788587670.635730:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587670.635731:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587670.635732:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587670.635733:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587670.635738:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788587670.635740:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788587670.635741:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788587670.635742:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788587670.635743:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587670.635744:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788587670.635747:0:5821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788587670.635749:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788587670.635750:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788587670.635751:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587670.635752:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587670.635753:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587670.635754:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587670.635754:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788587670.635755:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788587670.635756:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788587670.635757:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788587670.635758:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587670.635759:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788587670.635781:0:5821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788587670.635796:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a454f0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043843328:0@lo:253: 00000100:00100000:2.0:1788587670.635878:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587670.635911:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb77b40c going to sleep for 11 seconds 00000100:00100000:3.0:1788587670.636126:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043843328 00000100:00100000:3.0:1788587670.636133:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043843328 00000100:00100000:3.0:1788587670.636176:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788587670.636183:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000644f1742 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5821:x1875470043843328:12345-0@lo:253: 20000000:01000000:3.0:1788587670.636205:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788587670.636217:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788587670.660807:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788587670.660826:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788587670.660901:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788587670.660905:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788587670.660924:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.660952:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ef2ed611/0xa13e120d54ca8017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8010 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.660961:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.660997:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ef2ed611/0xa13e120d54ca8017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca8010 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.661010:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ef2ed611/0xa13e120d54ca8017 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca8010 expref: 12 pid: 5836 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587670.661041:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875470043843456:0@lo:104: 00000100:00100000:0.0:1788587670.661098:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587670.661150:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab4c375 going to sleep for 11 seconds 00000100:00100000:3.0:1788587670.661484:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043843456 00000100:00100000:3.0:1788587670.661491:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043843456 00000100:00100000:3.0:1788587670.661535:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587670.661543:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db8f6f57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:5857:x1875470043843456:12345-0@lo:104: 00010000:00010000:3.0:1788587670.661554:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8017 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587670.661599:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587670.661610:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db8f6f57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:5857:x1875470043843456:12345-0@lo:104: Request processed in 68us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587670.661617:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788587670.661702:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587670.661707:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8017 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.661714:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000097d333cc already unused, calling callback (00000000d898140d) 10000000:00010000:0.0:1788587670.661717:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca8017 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.661724:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca8017 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587670.661730:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca8017 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587670.661735:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587670.661759:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8017 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.661765:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587670.661781:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8017 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.661788:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca8010 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8017 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.661803:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587670.661810:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587670.661811:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587670.661889:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587670.661899:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000139fa332 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043843584:0@lo:103: 00000100:00100000:0.0:1788587670.661931:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587670.662089:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043843584 00000100:00100000:0.0:1788587670.662094:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043843584 00010000:00010000:0.0:1788587670.662112:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ef2ed611/0xa13e120d54ca8017 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8010 expref: 13 pid: 5836 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587670.662174:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587670.662181:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ee038be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:3302:x1875470043843584:12345-0@lo:103: 00010000:00010000:0.0:1788587670.662190:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587670.662195:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ef2ed611/0xa13e120d54ca8017 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8010 expref: 13 pid: 5836 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.662204:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ef2ed611/0xa13e120d54ca8017 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca8010 expref: 13 pid: 5836 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.662217:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.662224:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788587670.662236:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001331185s 00010000:00010000:0.0:1788587670.662240:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.662245:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.662261:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.662267:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.662272:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad8a97e1 already unused, calling callback (00000000e8289bfc) 00010000:00010000:0.0:1788587670.662275:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.662282:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.662289:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.662298:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587670.662328:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ee038be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:3302:x1875470043843584:12345-0@lo:103: Request processed in 148us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587670.662334:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788587670.662729:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ef2ed611/0xa13e120d54ca8017 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca8010 expref: 12 pid: 5836 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587670.662743:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875470043843456:0@lo:104: 00010000:00010000:0.0:1788587670.662758:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.662766:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.662781:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587670.662786:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ad8a97e1/0xa13e120d54ca8048 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587670.662809:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000139fa332 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043843584:0@lo:103: 00000100:00100000:2.0:1788587670.670475:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000644f1742 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5821:x1875470043843328:12345-0@lo:253: Request processed in 34285us (34589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587670.670490:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788587670.670576:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a454f0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:5821:1875470043843328:0@lo:253: 10000000:01000000:3.0:1788587670.670590:0:5821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788587670.670593:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788587670.670595:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788587670.670596:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587670.670597:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587670.670599:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587670.670600:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587670.670601:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587670.670602:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788587670.670603:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788587670.670605:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788587670.670606:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587670.670608:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788587670.670621:0:5821:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788587670.676316:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587670.677206:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587670.677417:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587670.681262:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587670.681548:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587670.682298:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587670.685772:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587670.686139:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587670.686343:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587670.686534:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587670.686721:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587670.686938:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788587670.734766:0:5821:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788587670.763571:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788587670.764084:0:5874:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788587670.764089:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788587670.764291:0:5875:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788587670.768422:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788587670.768645:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788587670.770104:0:5821:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788587670.770126:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788587670.770311:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587670.771495:0:5821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788587670.772704:0:5821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788587670.772750:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788587670.773036:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788587670.773267:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788587670.774811:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788587670.775159:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788587670.775321:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788587670.775480:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788587670.775632:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788587670.775786:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788587670.776408:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788587670.776607:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788587670.776764:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788587670.777136:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788587670.777357:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788587670.777517:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788587670.777661:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788587670.777805:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788587670.778175:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788587670.778327:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788587670.778644:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788587670.778780:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788587670.779162:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788587670.779313:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788587670.779489:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788587670.779640:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788587670.779821:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788587670.780357:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788587670.780520:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788587670.780665:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788587670.781092:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788587670.781240:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788587670.781394:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788587670.781555:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788587670.781714:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788587670.782052:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788587670.782264:0:5821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788587670.811364:0:5875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788587670.858400:0:5821:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788587670.858439:0:5821:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0dd015ef988 00100000:10000000:2.0:1788587670.858457:0:5821:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788587670.860434:0:5821:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788587670.860459:0:5821:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.133@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788587670.860471:0:5821:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788587670.860524:0:5821:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788587670.861881:0:5875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788587670.866833:0:5875:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788587670.866850:0:5875:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788587670.990555:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587672.009195:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587673.031954:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587674.056167:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788587674.956200:0:6117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg633-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788587675.080042:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587676.104668:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788587676.104956:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788587676.104963:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788587676.104978:0:36:0:(import.c:65:import_set_state_nolock()) 00000000dc7894ef lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587676.104990:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000dc7894ef using connection 192.168.206.133@tcp/0@lo 00000100:00100000:3.0:1788587676.105012:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006b6496be x1875470043843840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587676.105781:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b6496be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875470043843840:0@lo:38: 00000100:00100000:1.0:1788587676.105896:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587676.106077:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1e63d16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043843712:0@lo:400: 00000100:00100000:2.0:1788587676.106109:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587676.106158:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043843840 00000100:00100000:1.0:1788587676.106226:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043843712 00000100:00100000:1.0:1788587676.106244:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043843712 00000100:00100000:1.0:1788587676.106287:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788587676.106295:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce6e855a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:3304:x1875470043843712:12345-0@lo:400: 00000100:00100000:1.0:1788587676.106344:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce6e855a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:3304:x1875470043843712:12345-0@lo:400: Request processed in 50us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587676.106351:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788587676.106394:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1e63d16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043843712:0@lo:400: 00000100:00100000:0.0:1788587676.106429:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043843840 00000100:00100000:0.0:1788587676.106492:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587676.106497:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092b513f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1875470043843840:12345-0@lo:38: 00010000:00080000:0.0:1788587676.106520:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 123 last 0 00000020:00000080:0.0:1788587676.106553:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa13e120d54ca804f 00000004:00100000:0.0:1788587676.106607:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788587676.106720:0:5843:0:(import.c:65:import_set_state_nolock()) 00000000aea04fe3 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587676.106777:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092b513f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875470043843840:12345-0@lo:38: Request processed in 279us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587676.106785:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788587676.107334:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006b6496be x1875470043843840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587676.107369:0:3301:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788587676.107375:0:3301:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788587676.107380:0:3301:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788587676.107382:0:3301:0:(import.c:65:import_set_state_nolock()) 00000000dc7894ef lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788587676.107387:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b6496be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875470043843840:0@lo:38: 10000000:01000000:0.0:1788587676.616201:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788587676.616209:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88f488106000 from 3 10000000:01000000:0.0:1788587676.616213:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788587676.616365:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: 0000000045d0c4d9/0xa13e120d54ca8056 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587676.616397:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: 0000000045d0c4d9/0xa13e120d54ca8056 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587676.616407:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: 0000000045d0c4d9/0xa13e120d54ca8056 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587676.616439:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000139fa332 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043843968:0@lo:101: 00000100:00100000:0.0:1788587676.616503:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587676.616651:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 0000000058a2606c going to sleep for 11 seconds 00000100:00100000:2.0:1788587676.616973:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043843968 00000100:00100000:2.0:1788587676.616981:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043843968 00000100:00100000:2.0:1788587676.617387:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587676.617404:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000798e956 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5838:x1875470043843968:12345-0@lo:101: 00010000:00010000:2.0:1788587676.617428:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587676.617441:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000062a6ec91/0xa13e120d54ca805d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8056 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587676.617464:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000062a6ec91/0xa13e120d54ca805d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8056 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587676.617475:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000062a6ec91/0xa13e120d54ca805d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8056 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587676.617483:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000062a6ec91, rc 0) 00000100:00100000:2.0:1788587676.617537:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000798e956 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043843968:12345-0@lo:101: Request processed in 135us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587676.617544:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788587676.617625:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000139fa332 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043843968:0@lo:101: 00010000:00010000:0.0:1788587676.617638:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: 0000000045d0c4d9/0xa13e120d54ca8056 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca805d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587676.617655:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: 0000000045d0c4d9/0xa13e120d54ca8056 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca805d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587676.617711:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000139fa332 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043844096:0@lo:256: 00000100:00100000:0.0:1788587676.617744:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587676.618003:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 0000000058a2606c going to sleep for 11 seconds 00000100:00100000:1.0:1788587676.618801:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043844096 00000100:00100000:1.0:1788587676.618810:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043844096 00000100:00100000:1.0:1788587676.618869:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788587676.618877:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dae8a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043844096:12345-0@lo:256: 20000000:01000000:1.0:1788587676.618893:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788587676.618910:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788587676.618914:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788587676.619027:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dae8a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043844096:12345-0@lo:256: Request processed in 151us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587676.619034:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587676.619549:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000139fa332 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043844096:0@lo:256: 10000000:01000000:0.0:1788587676.619727:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788587676.619735:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: 0000000045d0c4d9/0xa13e120d54ca8056 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca805d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587676.619745:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: 0000000045d0c4d9/0xa13e120d54ca8056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca805d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587677.127997:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587678.152389:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587679.177079:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788587679.328337:0:6320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe57b3cec0 20000000:00000080:2.0:1788587679.328354:0:6320:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88f4af280c00 uarg=0000000000000000 20000000:01000000:2.0:1788587679.328385:0:6320:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788587679.328391:0:6320:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788587679.328395:0:6320:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788587679.328602:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788587679.328614:0:6320:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788587679.336307:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587679.336735:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788587679.336792:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788587679.336839:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788587679.336880:0:6320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788587679.336896:0:6320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587679.336913:0:6320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000045226332/0xa13e120d54ca8025 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca801e expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587679.336920:0:6320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587679.336955:0:6320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000045226332/0xa13e120d54ca8025 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca801e expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587679.336968:0:6320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000045226332/0xa13e120d54ca8025 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca801e expref: 11 pid: 5834 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587679.336981:0:6320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000008f36927 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1875470043844224:0@lo:104: 00000100:00100000:3.0:1788587679.337038:0:6320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587679.337131:0:6320:0:(client.c:2716:ptlrpc_set_wait()) set 00000000918463ff going to sleep for 11 seconds 00000100:00100000:0.0:1788587679.338352:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043844224 00000100:00100000:0.0:1788587679.338362:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043844224 00000100:00100000:0.0:1788587679.338420:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587679.338428:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfd3d425 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:6320:x1875470043844224:12345-0@lo:104: 00010000:00010000:0.0:1788587679.338444:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8025 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587679.338602:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587679.338608:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfd3d425 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:6320:x1875470043844224:12345-0@lo:104: Request processed in 181us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587679.338615:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788587679.338635:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587679.338640:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8025 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587679.341224:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009e57146d already unused, calling callback (00000000d898140d) 10000000:00010000:0.0:1788587679.341234:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca8025 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587679.341246:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca8025 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587679.341253:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca8025 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587679.341258:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587679.341296:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8025 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587679.341318:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587679.341344:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8025 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587679.341350:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: 000000009e57146d/0xa13e120d54ca801e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8025 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587679.341367:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587679.341369:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587679.341370:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587679.341545:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000139fa332 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043844352:0@lo:103: 00000100:00100000:1.0:1788587679.341604:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587679.341682:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043844352 00000100:00100000:1.0:1788587679.341688:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043844352 00010000:00010000:1.0:1788587679.342002:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000045226332/0xa13e120d54ca8025 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca801e expref: 12 pid: 5834 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587679.342033:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587679.342041:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a1e3927 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:3305:x1875470043844352:12345-0@lo:103: 00010000:00010000:1.0:1788587679.342053:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587679.342065:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000045226332/0xa13e120d54ca8025 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca801e expref: 12 pid: 5834 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587679.342075:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000045226332/0xa13e120d54ca8025 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca801e expref: 12 pid: 5834 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587679.342090:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587679.342098:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587679.342111:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587679.342117:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587679.342123:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587679.342128:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587679.342133:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009b270fcd already unused, calling callback (00000000e8289bfc) 00010000:00010000:1.0:1788587679.342136:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587679.342142:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587679.342149:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587679.342172:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587679.342199:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000045226332/0xa13e120d54ca8025 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca801e expref: 12 pid: 5834 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587679.342213:0:6320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000008f36927 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1875470043844224:0@lo:104: 00010000:00010000:2.0:1788587679.342319:0:6320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587679.342412:0:6320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587679.342419:0:6320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587679.342428:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009b270fcd/0xa13e120d54ca8064 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587679.342762:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a1e3927 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:3305:x1875470043844352:12345-0@lo:103: Request processed in 722us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587679.342769:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587679.342802:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000139fa332 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043844352:0@lo:103: 00010000:00010000:2.0:1788587680.202355:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587681.224097:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043844480:0@lo:400: 00000100:00100000:0.0:1788587681.224636:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587681.226516:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007013011f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043844608:0@lo:400: 00000100:00100000:0.0:1788587681.226572:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587681.227376:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587681.228734:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043844608 00000100:00100000:3.0:1788587681.228745:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043844608 00000100:00100000:3.0:1788587681.228808:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587681.228817:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000684905f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043844608:12345-0@lo:400: 00000100:00100000:3.0:1788587681.228932:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000684905f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043844608:12345-0@lo:400: Request processed in 117us (2359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587681.228940:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788587681.228993:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007013011f x1875470043844608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587681.229009:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007013011f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043844608:0@lo:400: 00000100:00100000:1.0:1788587681.229403:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043844480 00000100:00100000:1.0:1788587681.229408:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043844480 00000100:00100000:1.0:1788587681.229439:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788587681.229445:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000675a1064 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:3302:x1875470043844480:12345-0@lo:400: 00000100:00100000:1.0:1788587681.229488:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000675a1064 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:3302:x1875470043844480:12345-0@lo:400: Request processed in 43us (5326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587681.229494:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788587681.229543:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d0a2e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043844480:0@lo:400: 00010000:00010000:2.0:1788587682.248933:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587683.273686:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587684.301300:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788587684.882156:0:6690:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788587684.882160:0:6690:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788587684.882283:0:6690:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000bc8419e8 00000020:01000004:1.0:1788587684.882299:0:6690:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788587684.882309:0:6690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788587684.882333:0:6690:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (0000000025a995d1) 00000020:00000080:1.0:1788587684.882349:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788587684.900150:0:6690:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788587684.900559:0:6690:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788587684.920472:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788587684.926113:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788587684.926149:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788587684.926210:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788587684.926235:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788587684.926551:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788587684.926562:0:6690:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788587684.926572:0:6690:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa13e120d54ca8072 00000020:01000004:2.0:1788587684.926580:0:6690:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788587684.926600:0:6690:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.133@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788587684.926603:0:6690:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788587684.926609:0:6690:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788587684.926613:0:6690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788587684.926634:0:6690:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000035ccbaf3) 00000020:00000080:2.0:1788587684.926645:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788587684.927722:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587684.927906:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788587684.927912:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788587684.935310:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788587684.935325:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788587684.935690:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788587684.935696:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788587684.937424:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587684.937595:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788587684.937601:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788587684.938727:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788587684.938736:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788587684.970086:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587684.970294:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788587684.970300:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788587684.982414:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788587684.982430:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788587684.983336:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788587684.983344:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788587684.989402:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587684.989583:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788587684.989589:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788587684.992332:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788587684.992344:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788587685.063386:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587685.064747:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788587685.064755:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788587685.065975:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788587685.065985:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788587685.066530:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788587685.066552:0:6690:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788587685.066557:0:6690:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.133@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788587685.088656:0:6690:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.133@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788587685.088689:0:6690:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.133@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788587685.088693:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788587685.088695:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788587685.088697:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587685.088698:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587685.088699:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587685.088700:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587685.088702:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587685.088703:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788587685.088704:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788587685.088706:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587685.088707:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788587685.088710:0:6690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788587685.088713:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788587685.088714:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788587685.088715:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587685.088716:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587685.088717:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587685.088723:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587685.088724:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587685.088725:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788587685.088725:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788587685.088726:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587685.088727:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788587685.088752:0:6690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788587685.088767:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b39c42d pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043844736:0@lo:253: 00000100:00100000:2.0:1788587685.093892:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587685.094017:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f341313 going to sleep for 11 seconds 00000100:00100000:3.0:1788587685.094152:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043844736 00000100:00100000:3.0:1788587685.094163:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043844736 00000100:00100000:3.0:1788587685.094221:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587685.094229:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d649a0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043844736:12345-0@lo:253: 20000000:01000000:3.0:1788587685.094284:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788587685.094289:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788587685.094293:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788587685.094296:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788587685.095281:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587685.095507:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788587685.095520:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788587685.095558:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788587685.095575:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788587685.095609:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788587685.095673:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788587685.097454:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788587685.097480:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.133@tcp 20000000:01000000:3.0:1788587685.097482:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.133@tcp (null) (null) (null) 00000040:00080000:3.0:1788587685.097518:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788587685.097526:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788587685.097576:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788587685.097584:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.133@tcp (null) (null) 00000040:00080000:3.0:1788587685.097616:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788587685.097626:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788587685.098435:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788587685.098496:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788587685.099565:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788587685.099586:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.133@tcp 20000000:01000000:3.0:1788587685.099588:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.133@tcp (null) (null) (null) 00000040:00080000:3.0:1788587685.099622:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788587685.099631:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788587685.099661:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788587685.099669:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.133@tcp (null) (null) 00000040:00080000:3.0:1788587685.099710:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788587685.099721:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788587685.099750:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788587685.099782:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788587685.099797:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788587685.099800:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788587685.099806:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788587685.099807:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788587685.099809:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788587685.099821:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788587685.099832:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788587685.100111:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788587685.100114:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788587685.100767:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788587685.100821:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788587685.101035:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788587685.101389:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788587685.101432:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788587685.101489:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788587685.101504:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788587685.101506:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788587685.102033:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1788587685.102071:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1788587685.102116:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788587685.104155:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788587685.104217:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788587685.105225:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788587685.105248:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788587685.105251:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788587685.105811:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788587685.106178:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788587685.106214:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788587685.106277:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:3.0:1788587685.106293:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788587685.106310:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.106419:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000c59ce78/0xa13e120d54ca7fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca7fa0 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.106428:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000090932df0/0xa13e120d54ca7fc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca7fbc expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.106434:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000057def9af/0xa13e120d54ca8033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca802c expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.106440:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.106474:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000057def9af/0xa13e120d54ca8033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca802c expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.106617:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000057def9af/0xa13e120d54ca8033 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca802c expref: 11 pid: 5834 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587685.106631:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6535b1c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043844864:0@lo:104: 00000100:00100000:3.0:1788587685.106690:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587685.106793:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000090932df0/0xa13e120d54ca7fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca7fbc expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.106801:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000090932df0/0xa13e120d54ca7fc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca7fbc expref: 11 pid: 5834 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587685.106809:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab00f9ff pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043844992:0@lo:104: 00000100:00100000:3.0:1788587685.106831:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587685.107166:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000c59ce78/0xa13e120d54ca7fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca7fa0 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.107175:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000c59ce78/0xa13e120d54ca7fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca7fa0 expref: 11 pid: 5835 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587685.107183:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058ec1fd0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043845120:0@lo:104: 00000100:00100000:3.0:1788587685.107204:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587685.107242:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043844864 00000100:00100000:0.0:1788587685.107249:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043844864 00000100:00100000:0.0:1788587685.107281:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043844992 00000100:00100000:0.0:1788587685.107284:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043844992 00000100:00100000:0.0:1788587685.107310:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587685.107317:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9a0fed3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+4:5835:x1875470043844864:12345-0@lo:104: 00010000:00010000:0.0:1788587685.107338:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8033 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.107396:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587685.107402:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9a0fed3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+4:5835:x1875470043844864:12345-0@lo:104: Request processed in 85us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.107407:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587685.107422:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587685.107427:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053d6929d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:5835:x1875470043844992:12345-0@lo:104: 00010000:00010000:0.0:1788587685.107433:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca7fc3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.107462:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788587685.107467:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053d6929d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:5835:x1875470043844992:12345-0@lo:104: Request processed in 41us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.107472:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788587685.107523:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587685.107528:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8033 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.107536:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e229a801 already unused, calling callback (00000000d898140d) 10000000:00010000:2.0:1788587685.107539:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca8033 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.107546:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca8033 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587685.107552:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca8033 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587685.107557:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587685.107589:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8033 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.107596:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587685.107617:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8033 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.107624:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: 00000000e229a801/0xa13e120d54ca802c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8033 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.107648:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587685.107650:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca7fc3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.107656:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000efc4c98d already unused, calling callback (00000000d898140d) 10000000:00010000:2.0:1788587685.107659:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca7fc3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.107665:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca7fc3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587685.107670:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca7fc3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587685.107675:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587685.107688:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca7fc3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.107693:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587685.107698:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca7fc3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.107703:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: 00000000efc4c98d/0xa13e120d54ca7fbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca7fc3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.107712:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587685.107714:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587685.107715:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587685.107721:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587685.108740:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000adf3f622 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043845248:0@lo:103: 00000100:00100000:3.0:1788587685.108781:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.108873:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587685.108880:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ae78ebd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043845376:0@lo:103: 00000100:00100000:3.0:1788587685.108903:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.108956:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043845120 00000100:00100000:1.0:1788587685.108962:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043845120 00000100:00100000:0.0:1788587685.109044:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587685.109053:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cf17c02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:5835:x1875470043845120:12345-0@lo:104: 00010000:00010000:0.0:1788587685.109064:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca7fa7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.109104:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587685.109109:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cf17c02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:5835:x1875470043845120:12345-0@lo:104: Request processed in 58us (1905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.109114:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587685.109295:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 0000000026c6d90a going to sleep for 11 seconds 00000100:00100000:3.0:1788587685.109339:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6535b1c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043844864:0@lo:104: 00000100:00100000:3.0:1788587685.109349:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab00f9ff pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043844992:0@lo:104: 00000100:00100000:3.0:1788587685.109355:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058ec1fd0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043845120:0@lo:104: 00010000:00010000:3.0:1788587685.109388:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.109418:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587685.109421:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca7fa7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.109428:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a15a7cf8 already unused, calling callback (00000000d898140d) 10000000:00010000:3.0:1788587685.109430:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca7fa7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.109436:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca7fa7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587685.109441:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca7fa7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587685.109446:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587685.109469:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca7fa7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.109475:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587685.109489:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca7fa7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.109494:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: 00000000a15a7cf8/0xa13e120d54ca7fa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca7fa7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.109521:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587685.109523:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587685.109524:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587685.109531:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587685.109541:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058ec1fd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043845504:0@lo:103: 00000100:00100000:3.0:1788587685.109565:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587685.109725:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043845248 00000100:00100000:2.0:1788587685.109730:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043845248 00010000:00010000:2.0:1788587685.109751:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000057def9af/0xa13e120d54ca8033 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca802c expref: 12 pid: 5834 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587685.109780:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043845376 00000100:00100000:2.0:1788587685.109784:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043845376 00010000:00010000:2.0:1788587685.109795:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000090932df0/0xa13e120d54ca7fc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca7fbc expref: 13 pid: 5834 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587685.109808:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587685.109813:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b40f0213 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:3304:x1875470043845248:12345-0@lo:103: 00010000:00010000:2.0:1788587685.109824:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587685.109828:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000057def9af/0xa13e120d54ca8033 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca802c expref: 13 pid: 5834 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.109837:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000057def9af/0xa13e120d54ca8033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca802c expref: 13 pid: 5834 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.109867:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000057def9af/0xa13e120d54ca8033 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca802c expref: 13 pid: 5834 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.109881:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587685.109913:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b40f0213 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:3304:x1875470043845248:12345-0@lo:103: Request processed in 100us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587685.109919:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587685.109932:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587685.109938:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ce3134d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:3304:x1875470043845376:12345-0@lo:103: 00010000:00010000:2.0:1788587685.109945:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587685.109948:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000090932df0/0xa13e120d54ca7fc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca7fbc expref: 11 pid: 5834 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.109962:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000090932df0/0xa13e120d54ca7fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca7fbc expref: 11 pid: 5834 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.109971:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000090932df0/0xa13e120d54ca7fc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca7fbc expref: 11 pid: 5834 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.109980:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587685.110001:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ce3134d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:3304:x1875470043845376:12345-0@lo:103: Request processed in 64us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587685.110139:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788587685.110154:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788587685.110172:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ae78ebd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043845376:0@lo:103: 00000100:00100000:3.0:1788587685.110183:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000adf3f622 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043845248:0@lo:103: 00000100:00100000:1.0:1788587685.110303:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043845504 00000100:00100000:1.0:1788587685.110308:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043845504 00010000:00010000:1.0:1788587685.110339:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000c59ce78/0xa13e120d54ca7fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca7fa0 expref: 11 pid: 5835 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587685.110355:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788587685.110363:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587685.110369:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab00f9ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:3303:x1875470043845504:12345-0@lo:103: 00010000:00010000:1.0:1788587685.110389:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587685.110392:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000c59ce78/0xa13e120d54ca7fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca7fa0 expref: 11 pid: 5835 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.110401:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000c59ce78/0xa13e120d54ca7fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca7fa0 expref: 11 pid: 5835 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.110413:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000c59ce78/0xa13e120d54ca7fa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca7fa0 expref: 11 pid: 5835 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.110427:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.110435:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.110448:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.110455:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.110462:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.110473:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.110478:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000db33086a already unused, calling callback (00000000e8289bfc) 00010000:00010000:1.0:1788587685.110482:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.110489:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.110511:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.110521:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587685.110554:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab00f9ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:3303:x1875470043845504:12345-0@lo:103: Request processed in 186us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587685.110560:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587685.110587:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058ec1fd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043845504:0@lo:103: 00010000:00010000:3.0:1788587685.111805:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.111818:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.111824:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000db33086a/0xa13e120d54ca8080 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788587685.111853:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788587685.113276:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587685.147730:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d649a0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+8:6690:x1875470043844736:12345-0@lo:253: Request processed in 53496us (58884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587685.147744:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788587685.147863:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b39c42d pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043844736:0@lo:253: 10000000:01000000:2.0:1788587685.147889:0:6690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788587685.147892:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788587685.147894:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788587685.147895:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587685.147896:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788587685.147897:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587685.147898:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587685.147900:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587685.147901:0:6690:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788587685.147903:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587685.147904:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788587685.147923:0:6690:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bc8419e8 from lustre-OST0000 10000000:01000000:2.0:1788587685.147962:0:6690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788587685.147965:0:6690:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788587685.147970:0:6690:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88f48709cd40 local copy 10000000:01000000:2.0:1788587685.147974:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788587685.148004:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.148013:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.148026:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587685.148042:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b39c42d pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043845632:0@lo:101: 00000100:00100000:2.0:1788587685.148076:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587685.148133:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1a8dd11 going to sleep for 11 seconds 00000100:00100000:3.0:1788587685.148191:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043845632 00000100:00100000:3.0:1788587685.148200:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043845632 00000100:00100000:3.0:1788587685.148235:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788587685.148242:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cfbfa76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+8:6690:x1875470043845632:12345-0@lo:101: 00010000:00010000:3.0:1788587685.148253:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587685.148265:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db33086a/0xa13e120d54ca808e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8087 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.148292:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db33086a/0xa13e120d54ca808e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8087 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.148304:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db33086a/0xa13e120d54ca808e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8087 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.148310:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db33086a, rc 0) 00000100:00100000:3.0:1788587685.148350:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cfbfa76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:6690:x1875470043845632:12345-0@lo:101: Request processed in 109us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587685.148356:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587685.148542:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b39c42d pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043845632:0@lo:101: 00010000:00010000:2.0:1788587685.148554:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa13e120d54ca808e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.148563:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa13e120d54ca808e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587685.148657:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b39c42d pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043845760:0@lo:501: 00000100:00100000:2.0:1788587685.148683:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587685.148706:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1a8dd11 going to sleep for 11 seconds 00000100:00100000:3.0:1788587685.148760:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043845760 00000100:00100000:3.0:1788587685.148765:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043845760 00000100:00100000:3.0:1788587685.148793:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587685.148799:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000243097e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:6690:x1875470043845760:12345-0@lo:501: 00000100:00100000:3.0:1788587685.149000:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000243097e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:6690:x1875470043845760:12345-0@lo:501: Request processed in 201us (316us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587685.149008:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587685.149126:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b39c42d pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043845760:0@lo:501: 10000000:01000000:0.0:1788587685.149145:0:6690:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788587685.149171:0:6690:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788587685.149175:0:6690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa13e120d54ca808e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149183:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa13e120d54ca808e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149189:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa13e120d54ca808e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149213:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788587685.149229:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88f4baee9800 10000000:01000000:0.0:1788587685.149233:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788587685.149238:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff88f48709cd40 10000000:01000000:0.0:1788587685.149240:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788587685.149243:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff88f48709cd40 from 1 10000000:01000000:0.0:1788587685.149246:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788587685.149261:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: 00000000ad8a97e1/0xa13e120d54ca8095 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149268:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: 00000000ad8a97e1/0xa13e120d54ca8095 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149275:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: 00000000ad8a97e1/0xa13e120d54ca8095 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587685.149287:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043845888:0@lo:101: 00000100:00100000:0.0:1788587685.149313:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587685.149342:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043845888 00000100:00100000:0.0:1788587685.149346:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043845888 00000100:00100000:0.0:1788587685.149365:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587685.149382:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cc59de4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:6690:x1875470043845888:12345-0@lo:101: 00010000:00010000:0.0:1788587685.149390:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587685.149398:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c59ce78/0xa13e120d54ca809c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8095 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149412:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c59ce78/0xa13e120d54ca809c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8095 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149420:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c59ce78/0xa13e120d54ca809c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8095 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149427:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c59ce78, rc 0) 00000100:00100000:0.0:1788587685.149448:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cc59de4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:6690:x1875470043845888:12345-0@lo:101: Request processed in 78us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.149454:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587685.149480:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ea70f72f going to sleep for 11 seconds 00000100:00100000:0.0:1788587685.149492:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043845888:0@lo:101: 00010000:00010000:0.0:1788587685.149500:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: 00000000ad8a97e1/0xa13e120d54ca8095 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca809c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149507:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: 00000000ad8a97e1/0xa13e120d54ca8095 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca809c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587685.149520:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788587685.149530:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: 00000000ad8a97e1/0xa13e120d54ca8095 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca809c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149546:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: 00000000ad8a97e1/0xa13e120d54ca8095 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca809c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587685.149553:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788587685.149568:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587685.149571:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788587685.149573:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788587685.149586:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca80a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149592:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca80a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149598:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca80a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587685.149609:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043846016:0@lo:101: 00000100:00100000:0.0:1788587685.149634:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587685.149654:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043846016 00000100:00100000:0.0:1788587685.149657:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043846016 00000100:00100000:0.0:1788587685.149671:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587685.149676:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053c123f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:6690:x1875470043846016:12345-0@lo:101: 00010000:00010000:0.0:1788587685.149682:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587685.149688:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009e57146d/0xa13e120d54ca80aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca80a3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149701:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e57146d/0xa13e120d54ca80aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca80a3 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149720:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009e57146d/0xa13e120d54ca80aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca80a3 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149727:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009e57146d, rc 0) 00000100:00100000:0.0:1788587685.149748:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053c123f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043846016:12345-0@lo:101: Request processed in 72us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.149754:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587685.149773:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ea70f72f going to sleep for 11 seconds 00000100:00100000:0.0:1788587685.149783:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043846016:0@lo:101: 00010000:00010000:0.0:1788587685.149792:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca80a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca80aa expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.149798:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca80a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca80aa expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587685.149890:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043846144:0@lo:501: 00000100:00100000:0.0:1788587685.149914:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587685.149932:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043846144 00000100:00100000:0.0:1788587685.149936:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043846144 00000100:00100000:0.0:1788587685.149952:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587685.149957:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8951c18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043846144:12345-0@lo:501: 00000100:00100000:0.0:1788587685.150101:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8951c18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043846144:12345-0@lo:501: Request processed in 144us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.150108:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587685.150132:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ea70f72f going to sleep for 11 seconds 00000100:00100000:0.0:1788587685.150143:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043846144:0@lo:501: 00000100:00100000:0.0:1788587685.150171:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043846272:0@lo:503: 00000100:00100000:0.0:1788587685.150203:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587685.150221:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043846272 00000100:00100000:0.0:1788587685.150224:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043846272 00000100:00100000:0.0:1788587685.150240:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587685.150245:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068cfb566 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043846272:12345-0@lo:503: 00000100:00100000:0.0:1788587685.150362:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068cfb566 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043846272:12345-0@lo:503: Request processed in 116us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.150369:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587685.150409:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ea70f72f going to sleep for 11 seconds 00000100:00100000:0.0:1788587685.150420:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043846272:0@lo:503: 00000040:00080000:0.0:1788587685.150676:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788587685.150725:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043846400:0@lo:502: 00000100:00100000:0.0:1788587685.150757:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587685.150778:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043846400 00000100:00100000:0.0:1788587685.150782:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043846400 00000100:00100000:0.0:1788587685.150799:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587685.150804:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033cceaf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043846400:12345-0@lo:502: 00000100:00100000:0.0:1788587685.150946:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033cceaf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043846400:12345-0@lo:502: Request processed in 141us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.150953:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587685.150983:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ea70f72f going to sleep for 11 seconds 00000100:00100000:0.0:1788587685.150995:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043846400:0@lo:502: 00000040:00080000:0.0:1788587685.151198:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788587685.151243:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788587685.151279:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788587685.151338:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788587685.151390:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788587685.151426:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788587685.151448:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043846528:0@lo:502: 00000100:00100000:0.0:1788587685.151482:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587685.151506:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043846528 00000100:00100000:0.0:1788587685.151510:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043846528 00000100:00100000:0.0:1788587685.151530:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587685.151535:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dbcd666 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043846528:12345-0@lo:502: 00000100:00100000:0.0:1788587685.151642:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dbcd666 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043846528:12345-0@lo:502: Request processed in 106us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.151649:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587685.151682:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ea70f72f going to sleep for 11 seconds 00000100:00100000:0.0:1788587685.151696:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043846528:0@lo:502: 00000040:00080000:0.0:1788587685.151766:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788587685.151775:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00010000:00010000:3.0:1788587685.152162:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587685.152169:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa13e120d54ca808e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.152178:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005ff0a373 already unused, calling callback (00000000d898140d) 10000000:00010000:3.0:1788587685.152180:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa13e120d54ca808e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.152188:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa13e120d54ca808e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587685.152205:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa13e120d54ca808e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587685.152211:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587685.152233:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13e120d54ca808e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.152239:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587685.152269:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13e120d54ca808e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.152276:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: 000000005ff0a373/0xa13e120d54ca8087 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13e120d54ca808e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.152288:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587685.152290:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587685.152292:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587685.152299:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587685.152307:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6535b1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043846656:0@lo:103: 00000100:00100000:3.0:1788587685.152341:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.152397:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043846656 00000100:00100000:3.0:1788587685.152401:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043846656 00000100:00100000:3.0:1788587685.152437:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587685.152444:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062636809 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:3302:x1875470043846656:12345-0@lo:103: 00010000:00010000:3.0:1788587685.152454:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587685.152467:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000db33086a/0xa13e120d54ca808e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca8087 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.152478:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587685.152511:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062636809 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:3302:x1875470043846656:12345-0@lo:103: Request processed in 67us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587685.152517:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587685.152543:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6535b1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043846656:0@lo:103: 00000020:01000000:2.0:1788587685.153262:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788587685.153270:0:6709:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788587685.153276:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587685.153278:0:6709:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788587685.153283:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788587685.153296:0:6709:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (0000000020d5f151) 00000020:00000080:2.0:1788587685.153315:0:6709:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788587685.153321:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788587685.153388:0:6709:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bc8419e8 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788587685.153396:0:6709:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788587685.153402:0:6709:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa13e120d54ca80b8 00010000:00010000:2.0:1788587685.159172:0:6709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788587685.159482:0:6709:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788587685.163561:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788587685.164998:0:6709:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788587685.172530:0:6709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788587685.173524:0:6709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788587685.175064:0:6709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788587685.175085:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587685.175091:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587685.175093:0:6709:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788587685.175097:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587685.175100:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587685.175102:0:6709:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788587685.175105:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788587685.175106:0:6709:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788587685.175159:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587685.175163:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587685.175164:0:6709:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788587685.175167:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788587685.175219:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788587685.175240:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788587685.175253:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca80a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca80aa expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.175265:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: 0000000097d333cc/0xa13e120d54ca80a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca80aa expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587685.175273:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f4baee9800 from 1 10000000:01000000:0.0:1788587685.175276:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587685.175307:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: 00000000f091106a/0xa13e120d54ca80bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.175315:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: 00000000f091106a/0xa13e120d54ca80bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.175324:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: 00000000f091106a/0xa13e120d54ca80bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587685.175345:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043846784:0@lo:101: 00000100:00100000:0.0:1788587685.175416:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587685.175457:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e583a27 going to sleep for 11 seconds 00000100:00100000:0.0:1788587685.175486:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043846784 00000100:00100000:0.0:1788587685.175493:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043846784 00000100:00100000:0.0:1788587685.175526:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587685.175533:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e4b0124 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:6690:x1875470043846784:12345-0@lo:101: 00010000:00010000:0.0:1788587685.177074:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587685.177100:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000003e94708/0xa13e120d54ca80c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca80bf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.177127:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003e94708/0xa13e120d54ca80c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca80bf expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.177137:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000003e94708/0xa13e120d54ca80c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca80bf expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.177145:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000003e94708, rc 0) 00000100:00100000:0.0:1788587685.177206:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e4b0124 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043846784:12345-0@lo:101: Request processed in 1673us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.177215:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587685.177274:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043846784:0@lo:101: 00010000:00010000:0.0:1788587685.177288:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: 00000000f091106a/0xa13e120d54ca80bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca80c6 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.177297:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: 00000000f091106a/0xa13e120d54ca80bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca80c6 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587685.177407:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043846912:0@lo:501: 00000100:00100000:0.0:1788587685.177437:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587685.177475:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e583a27 going to sleep for 11 seconds 00000100:00100000:3.0:1788587685.177808:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043846912 00000100:00100000:3.0:1788587685.177814:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043846912 00000100:00100000:3.0:1788587685.178125:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788587685.178136:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cdd5c90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043846912:12345-0@lo:501: 00000100:00100000:3.0:1788587685.179177:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cdd5c90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043846912:12345-0@lo:501: Request processed in 1041us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587685.181552:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1ed253f pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043846912:0@lo:501: 00000100:00100000:1.0:1788587685.181608:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029d773cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847040:0@lo:503: 00000100:00100000:1.0:1788587685.181671:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.181712:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029500b2e going to sleep for 11 seconds 00000100:00100000:2.0:1788587685.181876:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043847040 00000100:00100000:2.0:1788587685.181882:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043847040 00000100:00100000:2.0:1788587685.181917:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587685.181924:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f94c53ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6690:x1875470043847040:12345-0@lo:503: 00000100:00100000:2.0:1788587685.182268:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f94c53ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6690:x1875470043847040:12345-0@lo:503: Request processed in 345us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587685.182277:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788587685.182622:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788587685.182730:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029d773cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847040:0@lo:503: 00000040:00080000:1.0:1788587685.183186:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587685.183254:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029d773cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847168:0@lo:502: 00000100:00100000:1.0:1788587685.183295:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.183332:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029500b2e going to sleep for 11 seconds 00000100:00100000:2.0:1788587685.183426:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043847168 00000100:00100000:2.0:1788587685.183431:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043847168 00000100:00100000:2.0:1788587685.183549:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788587685.183558:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000602e2174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043847168:12345-0@lo:502: 00000100:00100000:2.0:1788587685.183734:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000602e2174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043847168:12345-0@lo:502: Request processed in 178us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587685.183740:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788587685.184342:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029d773cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847168:0@lo:502: 00000040:00080000:1.0:1788587685.184603:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788587685.184654:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788587685.184682:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029d773cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847296:0@lo:502: 00000100:00100000:1.0:1788587685.184727:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.184982:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029500b2e going to sleep for 11 seconds 00000100:00100000:3.0:1788587685.185186:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043847296 00000100:00100000:3.0:1788587685.185192:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043847296 00000100:00100000:3.0:1788587685.185222:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587685.185228:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f7f1f21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043847296:12345-0@lo:502: 00000100:00100000:3.0:1788587685.185438:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f7f1f21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043847296:12345-0@lo:502: Request processed in 209us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587685.185446:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788587685.187459:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029d773cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847296:0@lo:502: 00000040:00080000:1.0:1788587685.187701:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788587685.187716:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788587685.189333:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587685.189343:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587685.189346:0:6713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788587685.189352:0:6713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88f4baee9800 00000020:00000080:2.0:1788587685.189355:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788587685.189403:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587685.189407:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587685.189409:0:6713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788587685.189412:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788587685.189531:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788587685.189563:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587685.189585:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca80bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca80c6 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.189596:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca80bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca80c6 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587685.189647:0:6690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788587685.189650:0:6690:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88f4baee9800 10000000:01000000:3.0:1788587685.189658:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88f4baee9800 10000000:01000000:3.0:1788587685.189662:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587685.189668:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88f4baee9800 from 1 10000000:01000000:3.0:1788587685.189671:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788587685.189704:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.189713:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.189723:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587685.189742:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4805500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847424:0@lo:101: 00000100:00100000:3.0:1788587685.189800:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.189836:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf57e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587685.190049:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043847424 00000100:00100000:3.0:1788587685.190055:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043847424 00000100:00100000:3.0:1788587685.190167:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788587685.190177:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043847424:12345-0@lo:101: 00010000:00010000:3.0:1788587685.190187:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587685.190198:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c21d4600/0xa13e120d54ca80d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca80cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.190221:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c21d4600/0xa13e120d54ca80d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca80cd expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.190231:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c21d4600/0xa13e120d54ca80d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca80cd expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.190240:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c21d4600, rc 0) 00000100:00100000:3.0:1788587685.190282:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6690:x1875470043847424:12345-0@lo:101: Request processed in 107us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587685.190289:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788587685.190327:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4805500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847424:0@lo:101: 00010000:00010000:3.0:1788587685.190340:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca80d4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.190348:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca80d4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587685.190445:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4805500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847552:0@lo:501: 00000100:00100000:3.0:1788587685.190469:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.190491:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf57e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587685.190554:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043847552 00000100:00100000:2.0:1788587685.190558:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043847552 00000100:00100000:2.0:1788587685.190588:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788587685.190595:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6690:x1875470043847552:12345-0@lo:501: 00000100:00100000:2.0:1788587685.190785:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6690:x1875470043847552:12345-0@lo:501: Request processed in 190us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587685.190797:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788587685.191018:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4805500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847552:0@lo:501: 00000100:00100000:3.0:1788587685.191045:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4805500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847680:0@lo:503: 00000100:00100000:3.0:1788587685.191156:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.191183:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf57e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587685.191227:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043847680 00000100:00100000:2.0:1788587685.191232:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043847680 00000100:00100000:2.0:1788587685.191258:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788587685.191264:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6690:x1875470043847680:12345-0@lo:503: 00000100:00100000:2.0:1788587685.191399:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6690:x1875470043847680:12345-0@lo:503: Request processed in 134us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587685.191405:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788587685.191479:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4805500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847680:0@lo:503: 00000040:00080000:3.0:1788587685.191776:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587685.191826:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4805500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847808:0@lo:502: 00000100:00100000:3.0:1788587685.192003:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.192065:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf57e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587685.192316:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043847808 00000100:00100000:2.0:1788587685.192321:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043847808 00000100:00100000:2.0:1788587685.192385:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788587685.192391:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6690:x1875470043847808:12345-0@lo:502: 00000100:00100000:2.0:1788587685.192536:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6690:x1875470043847808:12345-0@lo:502: Request processed in 144us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587685.192554:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788587685.192609:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4805500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847808:0@lo:502: 00000040:00080000:2.0:1788587685.193054:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788587685.193106:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788587685.193141:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788587685.193188:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788587685.193224:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788587685.193266:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788587685.193298:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788587685.193329:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788587685.193405:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788587685.193441:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788587685.193468:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788587685.193746:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788587685.193802:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788587685.193880:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788587685.193946:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788587685.193987:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788587685.194022:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788587685.194087:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788587685.194126:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788587685.194160:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788587685.194210:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788587685.194248:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788587685.194283:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788587685.194335:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788587685.194400:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788587685.194439:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788587685.194489:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788587685.194540:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788587685.194587:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847936:0@lo:502: 00000100:00100000:2.0:1788587685.194718:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587685.194762:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49339d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788587685.194975:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043847936 00000100:00100000:0.0:1788587685.194983:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043847936 00000100:00100000:0.0:1788587685.195028:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788587685.195037:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6690:x1875470043847936:12345-0@lo:502: 00000100:00100000:0.0:1788587685.195230:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6690:x1875470043847936:12345-0@lo:502: Request processed in 193us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.195245:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788587685.195430:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043847936:0@lo:502: 00000040:00080000:3.0:1788587685.195502:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788587685.195512:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788587685.196369:0:6714:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788587685.196404:0:6714:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff88f4bfb38000) 00000020:00000080:0.0:1788587685.196422:0:6714:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788587685.196498:0:6714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88f4baee9800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788587685.196502:0:6714:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88f4baee9800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788587685.196505:0:6714:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88f4baee9800 3 00010000:00080000:0.0:1788587685.196532:0:6714:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88f4bfb47800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.133@tcp at head 00010000:00010000:0.0:1788587685.200637:0:6714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788587685.201001:0:6714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788587685.201036:0:6714:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788587685.201048:0:6714:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa13e120d54ca80e2 00000100:00080000:0.0:1788587685.201058:0:6714:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788587685.201064:0:6714:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88f4bfb47800 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:0.0:1788587685.201109:0:6714:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f4c1943b80 x1875470043848064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587685.201139:0:6714:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788587685.201303:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875470043848064:0@lo:38: 00000100:00100000:3.0:1788587685.201420:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587685.201530:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043848064 00000100:00100000:0.0:1788587685.201622:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043848064 00000100:00100000:0.0:1788587685.201683:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587685.201690:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1875470043848064:12345-0@lo:38: 00010000:00080000:0.0:1788587685.201712:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 132 last 0 00000020:00000080:0.0:1788587685.201740:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa13e120d54ca80e9 00000004:00100000:0.0:1788587685.201754:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788587685.201783:0:5843:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb46800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587685.201835:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875470043848064:12345-0@lo:38: Request processed in 144us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.201992:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788587685.202031:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88f4c1943b80 x1875470043848064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587685.202042:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788587685.202049:0:3301:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788587685.202055:0:3301:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788587685.202059:0:3301:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788587685.202061:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb47800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788587685.202067:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875470043848064:0@lo:38: 00000100:00100000:3.0:1788587685.202440:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043848192:0@lo:400: 00000100:00100000:3.0:1788587685.202474:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788587685.202737:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788587685.202883:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788587685.202908:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788587685.202924:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca80d4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.202933:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca80d4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788587685.202974:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788587685.202976:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788587685.202978:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587685.202979:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587685.202980:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587685.202981:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587685.202982:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587685.202984:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788587685.202986:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788587685.202987:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587685.202988:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587685.202992:0:6690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788587685.202994:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587685.202995:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788587685.202996:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587685.202997:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587685.202998:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587685.202999:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587685.203000:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587685.203001:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788587685.203002:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788587685.203003:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587685.203004:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587685.203020:0:6690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788587685.203035:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4805500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043848320:0@lo:253: 00000100:00100000:3.0:1788587685.203277:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.203307:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043848320 00000100:00100000:3.0:1788587685.203312:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043848320 00000100:00100000:3.0:1788587685.203342:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788587685.203349:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6690:x1875470043848320:12345-0@lo:253: 20000000:01000000:3.0:1788587685.203368:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788587685.203477:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788587685.203931:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043848192 00000100:00100000:2.0:1788587685.203937:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043848192 00000100:00100000:2.0:1788587685.203968:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587685.203975:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043848192:12345-0@lo:400: 00000100:00100000:2.0:1788587685.204025:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043848192:12345-0@lo:400: Request processed in 50us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587685.204033:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788587685.204200:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88f4baa51180 x1875470043848192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587685.204214:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043848192:0@lo:400: 00000100:00100000:3.0:1788587685.204437:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf57ecc0 going to sleep for 11 seconds 20000000:01000000:3.0:1788587685.276110:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788587685.276128:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788587685.276242:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788587685.276247:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788587685.276267:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.276285:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f481539c00/0xa13e120d54ca805d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8056 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.276293:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.276331:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f481539c00/0xa13e120d54ca805d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca8056 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.276345:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f481539c00/0xa13e120d54ca805d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca8056 expref: 12 pid: 5836 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587685.276359:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875470043848448:0@lo:104: 00000100:00100000:0.0:1788587685.276440:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587685.276513:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bafd46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587685.276713:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043848448 00000100:00100000:3.0:1788587685.276721:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043848448 00000100:00100000:3.0:1788587685.276766:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587685.276774:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1940380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:5857:x1875470043848448:12345-0@lo:104: 00010000:00010000:3.0:1788587685.276787:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca8056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca805d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.276886:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587685.276892:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1940380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:5857:x1875470043848448:12345-0@lo:104: Request processed in 119us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587685.276898:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788587685.276917:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587685.276923:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca8056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca805d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.276929:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031000 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:3.0:1788587685.276933:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca8056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca805d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.276953:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca8056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca805d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587685.276961:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca8056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca805d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587685.276967:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587685.276993:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca8056 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca805d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.277001:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587685.277018:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca8056 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca805d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.277027:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca8056 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca805d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.277042:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587685.277044:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587685.277046:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587685.277063:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043848576:0@lo:103: 00000100:00100000:3.0:1788587685.277335:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.277425:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043848576 00000100:00100000:1.0:1788587685.277430:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043848576 00010000:00010000:1.0:1788587685.277449:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f481539c00/0xa13e120d54ca805d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8056 expref: 13 pid: 5836 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587685.277477:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587685.277484:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485c36050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:3305:x1875470043848576:12345-0@lo:103: 00010000:00010000:1.0:1788587685.277494:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587685.277499:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f481539c00/0xa13e120d54ca805d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8056 expref: 13 pid: 5836 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.277509:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f481539c00/0xa13e120d54ca805d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca8056 expref: 13 pid: 5836 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.277525:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.277533:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788587685.277568:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001331185s 00010000:00010000:1.0:1788587685.277573:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.277580:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.277587:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.277594:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.277600:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031800 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587685.277604:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.277612:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.277620:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.277628:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587685.277662:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485c36050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:3305:x1875470043848576:12345-0@lo:103: Request processed in 179us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587685.277669:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587685.277725:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043848576:0@lo:103: 00010000:00010000:2.0:1788587685.279729:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481539c00/0xa13e120d54ca805d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca8056 expref: 12 pid: 5836 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587685.279760:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875470043848448:0@lo:104: 00010000:00010000:2.0:1788587685.279781:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.279789:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.279796:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.279802:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f480031800/0xa13e120d54ca80f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587685.299740:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:6690:x1875470043848320:12345-0@lo:253: Request processed in 96382us (96454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587685.299765:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788587685.300017:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4805500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:6690:1875470043848320:0@lo:253: 10000000:01000000:3.0:1788587685.300032:0:6690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788587685.300035:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788587685.300037:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788587685.300038:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587685.300040:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587685.300041:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587685.300048:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587685.300049:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587685.300051:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788587685.300052:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788587685.300053:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587685.300055:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788587685.300147:0:6690:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788587685.305835:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587685.306132:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788587685.306346:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587685.306530:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788587685.306704:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587685.308628:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788587685.313269:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788587685.321355:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788587685.535588:0:6690:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788587685.535595:0:6690:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788587685.535623:0:6690:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788587685.535672:0:6690:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.133@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788587685.535686:0:6690:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788587685.535712:0:6690:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:1.0:1788587685.686208:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788587685.686214:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88f488106000 from 21 10000000:01000000:1.0:1788587685.686218:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788587685.686257:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.686269:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.686280:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587685.686301:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043848704:0@lo:101: 00000100:00100000:1.0:1788587685.686359:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.686408:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49339d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587685.686466:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043848704 00000100:00100000:2.0:1788587685.686474:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043848704 00000100:00100000:2.0:1788587685.686525:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788587685.686534:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5838:x1875470043848704:12345-0@lo:101: 00010000:00010000:2.0:1788587685.686546:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587685.686557:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f481539c00/0xa13e120d54ca80fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca80f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.686578:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f481539c00/0xa13e120d54ca80fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca80f7 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.686603:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f481539c00/0xa13e120d54ca80fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca80f7 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.686612:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481539c00, rc 0) 00000100:00100000:2.0:1788587685.686647:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043848704:12345-0@lo:101: Request processed in 115us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587685.686655:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788587685.686735:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043848704:0@lo:101: 00010000:00010000:1.0:1788587685.686749:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca80fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.686758:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca80fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587685.686805:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043848832:0@lo:501: 00000100:00100000:1.0:1788587685.686831:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.686871:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49339d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587685.686938:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043848832 00000100:00100000:2.0:1788587685.686943:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043848832 00000100:00100000:2.0:1788587685.686963:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788587685.686970:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043848832:12345-0@lo:501: 00000100:00100000:2.0:1788587685.687182:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043848832:12345-0@lo:501: Request processed in 212us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587685.687190:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587685.687257:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043848832:0@lo:501: 00000100:00100000:1.0:1788587685.687282:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043848960:0@lo:503: 00000100:00100000:1.0:1788587685.687321:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.687348:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49339d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587685.687400:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043848960 00000100:00100000:2.0:1788587685.687404:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043848960 00000100:00100000:2.0:1788587685.687432:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788587685.687438:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043848960:12345-0@lo:503: 00000100:00100000:2.0:1788587685.687559:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043848960:12345-0@lo:503: Request processed in 120us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587685.687566:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788587685.687635:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043848960:0@lo:503: 00000100:00100000:1.0:1788587685.687950:0:6728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:6728:1875470043849088:0@lo:502: 00000100:00100000:1.0:1788587685.687984:0:6728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.688014:0:6728:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49339da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587685.688057:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043849088 00000100:00100000:2.0:1788587685.688061:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043849088 00000100:00100000:2.0:1788587685.688090:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788587685.688097:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6728:x1875470043849088:12345-0@lo:502: 00000100:00100000:2.0:1788587685.688235:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6728:x1875470043849088:12345-0@lo:502: Request processed in 138us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587685.688247:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788587685.688320:0:6728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:6728:1875470043849088:0@lo:502: 00000100:00100000:1.0:1788587685.688357:0:6728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:6728:1875470043849216:0@lo:502: 00000100:00100000:1.0:1788587685.688399:0:6728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.688420:0:6728:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49339da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587685.688464:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043849216 00000100:00100000:2.0:1788587685.688468:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043849216 00000100:00100000:2.0:1788587685.688495:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788587685.688502:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6728:x1875470043849216:12345-0@lo:502: 00000100:00100000:2.0:1788587685.688608:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:6728:x1875470043849216:12345-0@lo:502: Request processed in 106us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587685.688615:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788587685.688687:0:6728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:6728:1875470043849216:0@lo:502: 00000040:00080000:1.0:1788587685.688705:0:6728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788587685.688828:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788587685.688876:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788587685.688886:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca80fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.688895:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca80fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587685.688904:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788587685.688906:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88f488106000 from 4 10000000:01000000:2.0:1788587685.688909:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788587685.688932:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.688939:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587685.688947:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587685.688960:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043849344:0@lo:101: 00000100:00100000:2.0:1788587685.688996:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587685.689014:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f381e18300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587685.689064:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043849344 00000100:00100000:1.0:1788587685.689068:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043849344 00000100:00100000:1.0:1788587685.689098:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788587685.689104:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043849344:12345-0@lo:101: 00010000:00010000:1.0:1788587685.689114:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587685.689125:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f481668200/0xa13e120d54ca810c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8105 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.689142:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f481668200/0xa13e120d54ca810c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8105 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.689150:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f481668200/0xa13e120d54ca810c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8105 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.689157:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481668200, rc 0) 00000100:00100000:1.0:1788587685.689192:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:5838:x1875470043849344:12345-0@lo:101: Request processed in 88us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587685.689198:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788587685.689229:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043849344:0@lo:101: 00010000:00010000:1.0:1788587685.689241:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca810c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.689250:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca810c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587685.689291:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043849472:0@lo:256: 00000100:00100000:1.0:1788587685.689318:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.689337:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043849472 00000100:00100000:1.0:1788587685.689340:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043849472 00000100:00100000:1.0:1788587685.689359:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788587685.689365:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:5838:x1875470043849472:12345-0@lo:256: 20000000:01000000:1.0:1788587685.689388:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788587685.689403:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788587685.689406:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788587685.689465:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:5838:x1875470043849472:12345-0@lo:256: Request processed in 99us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587685.689471:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788587685.689491:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49339d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587685.689502:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043849472:0@lo:256: 10000000:01000000:1.0:1788587685.689536:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788587685.689541:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca810c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.689558:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca810c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587685.689566:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788587685.689568:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788587685.689570:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788587685.689584:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.689592:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.689599:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587685.689610:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043849600:0@lo:101: 00000100:00100000:1.0:1788587685.689633:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.689649:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043849600 00000100:00100000:1.0:1788587685.689652:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043849600 00000100:00100000:1.0:1788587685.689669:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788587685.689674:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:5838:x1875470043849600:12345-0@lo:101: 00010000:00010000:1.0:1788587685.689681:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587685.689689:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f481668800/0xa13e120d54ca811a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8113 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.689702:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f481668800/0xa13e120d54ca811a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8113 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.689710:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f481668800/0xa13e120d54ca811a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8113 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.689723:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481668800, rc 0) 00000100:00100000:1.0:1788587685.689745:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043849600:12345-0@lo:101: Request processed in 71us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587685.689751:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788587685.689770:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49339d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587685.689780:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043849600:0@lo:101: 00010000:00010000:1.0:1788587685.689789:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca811a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.689796:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca811a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587685.689831:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043849728:0@lo:501: 00000100:00100000:1.0:1788587685.689878:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.689896:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043849728 00000100:00100000:1.0:1788587685.689900:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043849728 00000100:00100000:1.0:1788587685.689918:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788587685.689923:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043849728:12345-0@lo:501: 00000100:00100000:1.0:1788587685.690106:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043849728:12345-0@lo:501: Request processed in 182us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587685.690113:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788587685.690132:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49339d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587685.690142:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043849728:0@lo:501: 00000100:00100000:1.0:1788587685.690165:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043849856:0@lo:503: 00000100:00100000:1.0:1788587685.690199:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.690224:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043849856 00000100:00100000:1.0:1788587685.690228:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043849856 00000100:00100000:1.0:1788587685.690246:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788587685.690251:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043849856:12345-0@lo:503: 00000100:00100000:1.0:1788587685.690436:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043849856:12345-0@lo:503: Request processed in 184us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587685.690443:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788587685.690467:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49339d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587685.690478:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043849856:0@lo:503: 00000100:00100000:1.0:1788587685.690630:0:6729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:6729:1875470043849984:0@lo:502: 00000100:00100000:1.0:1788587685.690662:0:6729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.690679:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043849984 00000100:00100000:1.0:1788587685.690683:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043849984 00000100:00100000:1.0:1788587685.690702:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788587685.690707:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:6729:x1875470043849984:12345-0@lo:502: 00000100:00100000:1.0:1788587685.690882:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:6729:x1875470043849984:12345-0@lo:502: Request processed in 173us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587685.690888:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788587685.690916:0:6729:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4851ee240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587685.690928:0:6729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:6729:1875470043849984:0@lo:502: 00000020:01000000:1.0:1788587685.690947:0:6729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788587685.690953:0:6729:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788587685.690960:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587685.690962:0:6729:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788587685.690967:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788587685.690970:0:6729:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.133@tcp to nid 0x20000c0a8ce85 (192.168.206.133@tcp) 00000020:01000000:1.0:1788587685.690989:0:6729:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788587685.690997:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587685.691010:0:6729:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff88f4870299c0) 00000020:00000080:1.0:1788587685.691027:0:6729:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788587685.691032:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788587685.691091:0:6729:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788587685.691097:0:6729:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788587685.691104:0:6729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13e120d54ca8128 00010000:00080000:1.0:1788587685.691141:0:6729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88f4b487d000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.133@tcp at head 00010000:00010000:1.0:1788587685.691365:0:6729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788587685.750658:0:6729:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788587685.751236:0:6729:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788587685.753079:0:6729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587685.756656:0:6729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587685.756879:0:6729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788587685.756943:0:6729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788587685.759297:0:6732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587685.759303:0:6732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788587685.763250:0:6729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788587685.763263:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788587685.763297:0:6729:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788587685.763317:0:6729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13e120d54ca812f 00000100:00080000:3.0:1788587685.763328:0:6729:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587685.763334:0:6729:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88f4b487d000 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:3.0:1788587685.763366:0:6729:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f4b4805500 x1875470043850112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587685.765100:0:6729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788587685.765190:0:6729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587685.765197:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587685.765199:0:6729:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788587685.765203:0:6729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587685.765206:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587685.765208:0:6729:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788587685.765211:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788587685.765212:0:6729:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788587685.765245:0:6729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:6729:1875470043850240:0@lo:502: 00000100:00100000:3.0:1788587685.765317:0:6729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.765364:0:6729:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf57e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587685.765751:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043850240 00000100:00100000:3.0:1788587685.765758:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043850240 00000100:00100000:3.0:1788587685.765792:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788587685.765801:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:6729:x1875470043850240:12345-0@lo:502: 00000100:00100000:1.0:1788587685.767315:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043850112:0@lo:8: 00000100:00100000:1.0:1788587685.767386:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.767454:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043850112 00000100:00100000:1.0:1788587685.767460:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043850112 00000100:00100000:1.0:1788587685.767493:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587685.767499:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875470043850112:12345-0@lo:8: 00010000:00080000:1.0:1788587685.767522:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 133 last 0 00000020:00000080:1.0:1788587685.768855:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13e120d54ca8136 00002000:00100000:1.0:1788587685.768899:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88f4b487e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788587685.768905:0:6693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788587685.768909:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788587685.769900:0:6693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788587685.770060:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788587685.770090:0:6693:0:(import.c:65:import_set_state_nolock()) ffff88f4b487c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587685.770571:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875470043850112:12345-0@lo:8: Request processed in 3068us (3182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587685.770581:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788587685.770636:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4b4805500 x1875470043850112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587685.770647:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788587685.770655:0:3301:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788587685.770675:0:3301:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788587685.770681:0:3301:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788587685.770684:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4b487d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788587685.770693:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788587685.770698:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043850112:0@lo:8: 00000004:00080000:1.0:1788587685.770724:0:6732:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788587685.770833:0:6732:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 133025989660ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788587685.783030:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:6729:x1875470043850240:12345-0@lo:502: Request processed in 17222us (17705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587685.783049:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788587685.783415:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043850368:0@lo:400: 00000100:00100000:3.0:1788587685.783452:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.783542:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587685.783550:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043850496:0@lo:400: 00000100:00100000:3.0:1788587685.783573:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.783683:0:6729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:6729:1875470043850240:0@lo:502: 00000020:01000000:3.0:1788587685.783714:0:6729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587685.783721:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587685.783723:0:6729:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788587685.783729:0:6729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788587685.783879:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788587685.783894:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788587685.783903:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca811a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.783914:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca811a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587685.783923:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788587685.783925:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f488106000 from 1 10000000:01000000:3.0:1788587685.783928:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587685.783956:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.783964:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.783973:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587685.783993:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043850624:0@lo:101: 00000100:00100000:3.0:1788587685.784019:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.784039:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf57e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587685.784053:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043850624 00000100:00100000:3.0:1788587685.784059:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043850624 00000100:00100000:3.0:1788587685.784094:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788587685.784102:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043850624:12345-0@lo:101: 00010000:00010000:3.0:1788587685.784236:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587685.784249:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c21d4000/0xa13e120d54ca8144 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca813d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.784273:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c21d4000/0xa13e120d54ca8144 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca813d expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.784284:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c21d4000/0xa13e120d54ca8144 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca813d expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.784293:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c21d4000, rc 0) 00000100:00100000:3.0:1788587685.784325:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043850624:12345-0@lo:101: Request processed in 223us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587685.784331:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788587685.784361:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043850624:0@lo:101: 00010000:00010000:3.0:1788587685.784383:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8144 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.784392:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca8144 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587685.784445:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043850752:0@lo:501: 00000100:00100000:3.0:1788587685.784467:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.784479:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf57e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587685.784491:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043850752 00000100:00100000:3.0:1788587685.784494:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043850752 00000100:00100000:3.0:1788587685.784511:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788587685.784517:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043850752:12345-0@lo:501: 00000100:00100000:3.0:1788587685.784727:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043850752:12345-0@lo:501: Request processed in 209us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587685.784734:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788587685.784762:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043850752:0@lo:501: 00000100:00100000:3.0:1788587685.784786:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043850880:0@lo:503: 00000100:00100000:3.0:1788587685.784819:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.784837:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf57e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587685.784994:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043850880 00000100:00100000:3.0:1788587685.784999:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043850880 00000100:00100000:3.0:1788587685.785019:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788587685.785025:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043850880:12345-0@lo:503: 00000100:00100000:3.0:1788587685.785279:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043850880:12345-0@lo:503: Request processed in 254us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587685.785286:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788587685.785323:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043850880:0@lo:503: 00000100:00100000:2.0:1788587685.786462:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043850368 00000100:00100000:2.0:1788587685.786470:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043850368 00000100:00100000:2.0:1788587685.786502:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043850496 00000100:00100000:2.0:1788587685.786506:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043850496 00000100:00100000:2.0:1788587685.786527:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587685.786535:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043850368:12345-0@lo:400: 00000100:00100000:2.0:1788587685.786601:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043850368:12345-0@lo:400: Request processed in 67us (3148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587685.786608:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587685.786621:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587685.786628:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043850496:12345-0@lo:400: 00000100:00100000:2.0:1788587685.786654:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043850496:12345-0@lo:400: Request processed in 27us (3080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587685.786659:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788587685.786675:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788587685.787503:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4b4804000 x1875470043850496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587685.787531:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043850496:0@lo:400: 00010000:00080000:3.0:1788587685.787544:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4b4807800 x1875470043850368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587685.787552:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043850368:0@lo:400: 00000100:00100000:0.0:1788587685.794093:0:6735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:6735:1875470043851008:0@lo:502: 00000100:00100000:0.0:1788587685.794180:0:6735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587685.796168:0:6735:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f382cb4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587685.799058:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043851008 00000100:00100000:1.0:1788587685.799072:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043851008 00000100:00100000:0.0:1788587685.807170:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788587685.807184:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:6735:x1875470043851008:12345-0@lo:502: 00000100:00100000:0.0:1788587685.807438:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:6735:x1875470043851008:12345-0@lo:502: Request processed in 256us (13258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.807445:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788587685.807502:0:6735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:6735:1875470043851008:0@lo:502: 00000020:01000000:0.0:1788587685.807532:0:6735:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587685.807541:0:6735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587685.807543:0:6735:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788587685.807550:0:6735:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88f488106000 00000020:00000080:0.0:1788587685.807552:0:6735:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788587685.807580:0:6735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:6735:1875470043851136:0@lo:502: 00000100:00100000:0.0:1788587685.807617:0:6735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587685.807650:0:6735:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f382cb4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788587685.807759:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043851136 00000100:00100000:3.0:1788587685.807766:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043851136 00000100:00100000:3.0:1788587685.807796:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788587685.807803:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:6735:x1875470043851136:12345-0@lo:502: 00000100:00100000:3.0:1788587685.807942:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:6735:x1875470043851136:12345-0@lo:502: Request processed in 139us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587685.807949:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788587685.808183:0:6735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:6735:1875470043851136:0@lo:502: 00000020:01000000:0.0:1788587685.808203:0:6735:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587685.808208:0:6735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587685.808209:0:6735:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788587685.808212:0:6735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788587685.808324:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788587685.808340:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587685.808348:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8144 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.808360:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8144 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587685.808378:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788587685.808381:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88f48709cd40 from 1 10000000:01000000:3.0:1788587685.808384:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788587685.808409:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.808416:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587685.808435:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587685.808448:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043851264:0@lo:101: 00000100:00100000:3.0:1788587685.808477:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.808507:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf57e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587685.808550:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043851264 00000100:00100000:0.0:1788587685.808555:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043851264 00000100:00100000:0.0:1788587685.808583:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788587685.808590:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043851264:12345-0@lo:101: 00010000:00010000:0.0:1788587685.808597:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587685.808608:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f480031400/0xa13e120d54ca8152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca814b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.808628:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f480031400/0xa13e120d54ca8152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca814b expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.808639:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f480031400/0xa13e120d54ca8152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca814b expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587685.808648:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031400, rc 0) 00000100:00100000:0.0:1788587685.808683:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043851264:12345-0@lo:101: Request processed in 93us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.808688:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788587685.808756:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043851264:0@lo:101: 00010000:00010000:1.0:1788587685.808835:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8152 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.808869:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca8152 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587685.808914:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043851392:0@lo:501: 00000100:00100000:1.0:1788587685.808939:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587685.808956:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587685.808973:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043851392 00000100:00100000:1.0:1788587685.808977:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043851392 00000100:00100000:1.0:1788587685.808996:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788587685.809002:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043851392:12345-0@lo:501: 00000100:00100000:1.0:1788587685.809243:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043851392:12345-0@lo:501: Request processed in 240us (302us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587685.809249:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788587685.809278:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043851392:0@lo:501: 10000000:01000000:1.0:1788587685.809296:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788587685.809301:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8152 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587685.809308:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8152 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587685.820215:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788587685.871515:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:2.0:1788587685.871558:0:6734:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788587685.871581:0:6734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa50000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875470043851648:0@lo:7: 00000100:00100000:2.0:1788587685.871639:0:6734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587685.871682:0:6734:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f381e18300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587685.871732:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043851648 00000100:00100000:0.0:1788587685.871738:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043851648 00000100:00100000:0.0:1788587685.871785:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587685.871793:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6734:x1875470043851648:12345-0@lo:7: 00000100:00080000:2.0:1788587685.874610:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587685.877764:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043851520:0@lo:13: 00000100:00100000:1.0:1788587685.877831:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.877953:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043851520 00000100:00100000:3.0:1788587685.877961:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043851520 00000100:00100000:3.0:1788587685.878010:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587685.878019:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875470043851520:12345-0@lo:13: 00002000:00000024:3.0:1788587685.878040:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:3.0:1788587685.878084:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875470043851520:12345-0@lo:13: Request processed in 66us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587685.878090:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788587685.878129:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4baa52300 x1875470043851520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587685.878147:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043851520:0@lo:13: 00002000:00080000:1.0:1788587685.879736:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788587685.879742:0:6695:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788587685.879892:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6734:x1875470043851648:12345-0@lo:7: Request processed in 8097us (8250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587685.879902:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788587685.880311:0:6734:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4baa50000 x1875470043851648/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788587701 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587685.880324:0:6734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa50000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875470043851648:0@lo:7: 00000004:00080000:3.0:1788587685.880336:0:6734:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788587685.880397:0:6734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4804000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875470043851776:0@lo:5: 00000100:00100000:3.0:1788587685.880427:0:6734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.880507:0:6734:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf57e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587685.880551:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043851776 00000100:00100000:0.0:1788587685.880557:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043851776 00000100:00100000:0.0:1788587685.880642:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587685.880651:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6734:x1875470043851776:12345-0@lo:5: 00002000:00080000:0.0:1788587685.880671:0:6694:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788587685.880674:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788587685.884189:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6734:x1875470043851776:12345-0@lo:5: Request processed in 3531us (3752us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788587685.884201:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788587685.884282:0:6734:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4b4804000 x1875470043851776/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587701 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587685.884311:0:6734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4804000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875470043851776:0@lo:5: 00000004:00080000:3.0:1788587685.884324:0:6734:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788587685.884358:0:6734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875470043851904:0@lo:700: 00000100:00100000:3.0:1788587685.884403:0:6734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.884440:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043851904 00000100:00100000:3.0:1788587685.884446:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043851904 00000100:00100000:3.0:1788587685.884477:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587685.884484:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6734:x1875470043851904:12345-0@lo:700: 00000100:00100000:3.0:1788587685.884511:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4804a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6701:1875470043852032:0@lo:700: 00000100:00100000:3.0:1788587685.884535:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587685.884561:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf57eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587685.884584:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043852032 00000100:00100000:3.0:1788587685.884587:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043852032 00000100:00100000:3.0:1788587685.884612:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587685.884618:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6701:x1875470043852032:12345-0@lo:700: 00000100:00100000:3.0:1788587685.885692:0:6734:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf57e3c0 going to sleep for 11 seconds 40000000:02000000:1.0:1788587685.913412:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788587685.918396:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6701:x1875470043852032:12345-0@lo:700: Request processed in 33770us (33851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587685.918415:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788587685.918525:0:6701:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4b4804a80 x1875470043852032/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788587701 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587685.918539:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4804a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6701:1875470043852032:0@lo:700: 40000000:02000000:3.0:1788587685.918551:0:6701:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1788587685.994257:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788587685.994293:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788587685.995705:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6734:x1875470043851904:12345-0@lo:700: Request processed in 111214us (111295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587685.995719:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788587685.995811:0:6734:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4b4807800 x1875470043851904/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788587701 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587685.995824:0:6734:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788587685.995839:0:6734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875470043851904:0@lo:700: 00000004:02000040:2.0:1788587686.065765:0:6734:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788587686.081939:0:6734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875470043852160:0@lo:5: 00000100:00100000:0.0:1788587686.082007:0:6734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587686.082055:0:6734:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f382cb4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587686.082349:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043852160 00000100:00100000:1.0:1788587686.082357:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043852160 00000100:00100000:1.0:1788587686.084792:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587686.084810:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6734:x1875470043852160:12345-0@lo:5: 00002000:00080000:0.0:1788587686.098357:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788587686.100916:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788587686.112140:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6734:x1875470043852160:12345-0@lo:5: Request processed in 27329us (30125us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788587686.112154:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788587686.112237:0:6734:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4c1941f80 x1875470043852160/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587702 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587686.112253:0:6734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6734:1875470043852160:0@lo:5: 00000004:00080000:0.0:1788587686.112267:0:6734:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1788587686.344215:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587687.373292:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587688.394798:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587689.418003:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587690.440676:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587690.952565:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587690.952589:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043852288:0@lo:13: 00000100:00100000:0.0:1788587690.952659:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587690.955142:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043852416:0@lo:400: 00000100:00100000:3.0:1788587690.955189:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587690.955202:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043852672:0@lo:400: 00000100:00100000:1.0:1788587690.955203:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587690.955233:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587690.955277:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043852288 00000100:00100000:3.0:1788587690.955283:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043852288 00000100:00080000:2.0:1788587690.955322:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587690.955328:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587690.955334:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043852672 00000100:00100000:3.0:1788587690.955335:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043852288:12345-0@lo:13: 00000100:00100000:2.0:1788587690.955337:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043852672 00002000:00000024:3.0:1788587690.955377:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587690.955381:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587690.955387:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043852672:12345-0@lo:400: 00000100:00100000:3.0:1788587690.955416:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043852288:12345-0@lo:13: Request processed in 81us (2757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587690.955418:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043852672:12345-0@lo:400: Request processed in 33us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587690.955423:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587690.955424:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788587690.955514:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788587690.955543:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4833a3b80 x1875470043852672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587690.955555:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043852672:0@lo:400: 00000100:00100000:1.0:1788587690.955691:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587690.955698:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043852544:0@lo:400: 00000100:00100000:1.0:1788587690.955723:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587690.955756:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043852416 00000100:00100000:1.0:1788587690.955760:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043852416 00000100:00100000:1.0:1788587690.955785:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788587690.955792:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485ca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:3302:x1875470043852416:12345-0@lo:400: 00000100:00100000:1.0:1788587690.955825:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485ca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:3302:x1875470043852416:12345-0@lo:400: Request processed in 34us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587690.955831:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788587690.956104:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043852544 00000100:00100000:1.0:1788587690.956109:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043852544 00000100:00100000:1.0:1788587690.956171:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587690.956178:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043852544:12345-0@lo:400: 00000100:00100000:1.0:1788587690.956222:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043852544:12345-0@lo:400: Request processed in 45us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587690.956229:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788587690.957195:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4833a2a00 x1875470043852544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587690.957277:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043852544:0@lo:400: 00000100:00100000:1.0:1788587690.957299:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043852416:0@lo:400: 00010000:00080000:1.0:1788587690.957335:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4c1942680 x1875470043852288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587690.957363:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043852288:0@lo:13: 00000001:00080000:1.0:1788587691.007693:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:1.0:1788587691.203645:0:7062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg633-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788587691.470023:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587692.489433:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587693.512226:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587694.537266:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587695.561719:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587696.073220:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043852800:0@lo:13: 00000100:00100000:1.0:1788587696.073280:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587696.074616:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043853184:0@lo:400: 00000100:00100000:1.0:1788587696.074666:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587696.074713:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043852928:0@lo:400: 00000100:00100000:1.0:1788587696.074743:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587696.074768:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587696.074773:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043853056:0@lo:400: 00000100:00100000:1.0:1788587696.074795:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587696.074890:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043852928 00000100:00100000:1.0:1788587696.074899:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043852928 00000100:00100000:1.0:1788587696.074942:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788587696.074944:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043853184 00000100:00100000:2.0:1788587696.074948:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043853184 00000100:00100000:1.0:1788587696.074950:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:3302:x1875470043852928:12345-0@lo:400: 00000100:00100000:2.0:1788587696.074978:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043853056 00000100:00100000:2.0:1788587696.074980:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043853056 00000100:00100000:2.0:1788587696.074994:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587696.075000:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043853184:12345-0@lo:400: 00000100:00100000:1.0:1788587696.075169:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:3302:x1875470043852928:12345-0@lo:400: Request processed in 219us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587696.075177:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587696.075218:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788587696.075226:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788587696.075243:0:5843:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788587696.075250:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587696.075257:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043853056:12345-0@lo:400: 00000100:00100000:3.0:1788587696.077122:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043852800 00000100:00100000:3.0:1788587696.077137:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043852800 00000100:00100000:3.0:1788587696.077190:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587696.077199:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043852800:12345-0@lo:13: 00002000:00000024:3.0:1788587696.077231:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587696.077609:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043853184:12345-0@lo:400: Request processed in 2606us (2940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587696.077618:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788587696.077644:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587696.077648:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788587696.080168:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4833a1c00 x1875470043853184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587696.080186:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043853184:0@lo:400: 00000100:00100000:0.0:1788587696.080225:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043852928:0@lo:400: 00000100:00100000:0.0:1788587696.080249:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043853312:0@lo:400: 00000100:00100000:0.0:1788587696.080310:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587696.080364:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043853312 00000100:00100000:0.0:1788587696.080370:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043853312 00000100:00100000:0.0:1788587696.080406:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587696.080414:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875470043853312:12345-0@lo:400: 00000100:00100000:0.0:1788587696.080461:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875470043853312:12345-0@lo:400: Request processed in 48us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587696.080468:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788587696.080497:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4833a2680 x1875470043853312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587696.080506:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788587696.080517:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043853312:0@lo:400: 00000100:00100000:1.0:1788587696.082152:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043853056:12345-0@lo:400: Request processed in 6887us (7348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587696.082164:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788587696.082405:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4833a1f80 x1875470043853056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587696.082420:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043853056:0@lo:400: 00000100:00100000:3.0:1788587696.088114:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043852800:12345-0@lo:13: Request processed in 10907us (14824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587696.088128:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788587696.088175:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4833a0a80 x1875470043852800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587696.088199:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043852800:0@lo:13: 00010000:00010000:1.0:1788587696.584378:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587697.613620:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587698.632007:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587699.656123:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587700.680056:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587701.193181:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043853440:0@lo:13: 00000100:00100000:0.0:1788587701.193273:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587701.193396:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043853440 00000100:00100000:0.0:1788587701.193406:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043853440 00000100:00100000:0.0:1788587701.193466:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587701.193477:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043853440:12345-0@lo:13: 00002000:00000024:0.0:1788587701.193522:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587701.193575:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043853440:12345-0@lo:13: Request processed in 99us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587701.193583:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788587701.193633:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4c1941f80 x1875470043853440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587701.193656:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043853440:0@lo:13: 00000100:00100000:0.0:1788587701.195300:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043853568:0@lo:400: 00000100:00100000:0.0:1788587701.195384:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788587701.195512:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587701.195525:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043853824:0@lo:400: 00000100:00100000:2.0:1788587701.195562:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587701.195614:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587701.195621:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043853696:0@lo:400: 00000100:00100000:2.0:1788587701.195646:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587701.195679:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043853824 00000100:00100000:2.0:1788587701.195687:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043853824 00000100:00100000:2.0:1788587701.195744:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043853696 00000100:00100000:2.0:1788587701.195748:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043853696 00000100:00100000:2.0:1788587701.195775:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587701.195798:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043853824:12345-0@lo:400: 00000100:00100000:2.0:1788587701.195874:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043853824:12345-0@lo:400: Request processed in 91us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587701.195882:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587701.195902:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587701.195909:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043853696:12345-0@lo:400: 00000100:00100000:2.0:1788587701.195935:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043853696:12345-0@lo:400: Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587701.195940:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788587701.195958:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788587701.195990:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4baa53100 x1875470043853696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587701.196005:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043853696:0@lo:400: 00010000:00080000:2.0:1788587701.196017:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4baa51500 x1875470043853824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587701.196025:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043853824:0@lo:400: 00000100:00100000:1.0:1788587701.200814:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043853568 00000100:00100000:1.0:1788587701.200832:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043853568 00000100:00100000:1.0:1788587701.201009:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788587701.201021:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:3303:x1875470043853568:12345-0@lo:400: 00000100:00100000:1.0:1788587701.201145:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:3303:x1875470043853568:12345-0@lo:400: Request processed in 126us (5760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587701.201154:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788587701.201388:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043853568:0@lo:400: 00010000:00010000:1.0:1788587701.706994:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788587701.921026:0:7631:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788587701.921029:0:7631:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788587701.921160:0:7631:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88f4b487a800 00000020:01000004:3.0:1788587701.921174:0:7631:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788587701.921186:0:7631:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788587701.921198:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff88f485698000) 00000020:00000080:3.0:1788587701.921212:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788587701.936159:0:7631:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788587701.936406:0:7631:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788587701.958248:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788587701.962590:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788587701.962638:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788587701.962697:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788587701.962724:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788587701.963144:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788587701.963156:0:7631:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788587701.963167:0:7631:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa13e120d54ca8160 00000020:01000004:2.0:1788587701.963175:0:7631:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788587701.963197:0:7631:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.133@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788587701.963200:0:7631:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788587701.963205:0:7631:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788587701.963227:0:7631:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788587701.963231:0:7631:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.133@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788587701.978670:0:7631:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.133@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788587701.978707:0:7631:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.133@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788587701.978711:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788587701.978712:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788587701.978714:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587701.978715:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587701.978717:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587701.978718:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587701.978719:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587701.978721:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788587701.978722:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788587701.978724:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587701.978725:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788587701.978729:0:7631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788587701.978731:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788587701.978732:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788587701.978734:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587701.978735:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587701.978736:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587701.978737:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587701.978738:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587701.978739:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788587701.978745:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788587701.978746:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587701.978747:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788587701.978773:0:7631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788587701.978892:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043853952:0@lo:253: 00000100:00100000:2.0:1788587701.978974:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587701.979087:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486589000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587701.979131:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043853952 00000100:00100000:1.0:1788587701.979139:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043853952 00000100:00100000:1.0:1788587701.979236:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788587701.979245:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:7631:x1875470043853952:12345-0@lo:253: 20000000:01000000:1.0:1788587701.979273:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788587701.979277:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788587701.979296:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788587701.979307:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788587701.980278:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587701.980477:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788587701.980491:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788587701.980530:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788587701.980539:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788587701.980568:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788587701.980614:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788587701.981224:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788587701.981244:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.133@tcp 20000000:01000000:1.0:1788587701.981246:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.133@tcp (null) (null) (null) 00000040:00080000:1.0:1788587701.981585:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788587701.981599:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788587701.981661:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788587701.981669:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.133@tcp (null) (null) 00000040:00080000:1.0:1788587701.981702:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788587701.981712:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788587701.981744:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788587701.981994:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788587701.982924:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788587701.982945:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.133@tcp 20000000:01000000:1.0:1788587701.982947:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.133@tcp (null) (null) (null) 00000040:00080000:1.0:1788587701.982994:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788587701.983002:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788587701.983032:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788587701.983040:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.133@tcp (null) (null) 00000040:00080000:1.0:1788587701.983066:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788587701.983074:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788587701.983131:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788587701.983170:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788587701.983187:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788587701.983195:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788587701.983200:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788587701.983202:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788587701.983205:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788587701.983217:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788587701.983219:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788587701.983252:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788587701.983255:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788587701.984538:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788587701.985041:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788587701.985087:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788587701.985154:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788587701.985167:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788587701.985170:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788587701.985732:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788587701.985951:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788587701.986014:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788587701.986346:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788587701.986390:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788587701.986449:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788587701.986463:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788587701.986464:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788587701.987046:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788587701.987092:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788587701.987142:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788587701.987430:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788587701.987462:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788587701.987488:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788587701.987498:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788587701.987499:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788587701.988306:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788587701.988369:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788587701.988408:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788587701.988628:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788587701.988661:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788587701.988726:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:1.0:1788587701.988741:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788587701.988757:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.988774:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f480031a00/0xa13e120d54ca80aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca80a3 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.989371:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4c21d4600/0xa13e120d54ca80d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca80cd expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.989387:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f481539c00/0xa13e120d54ca80fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca80f7 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.989393:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f481668800/0xa13e120d54ca811a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8113 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.989398:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f480031400/0xa13e120d54ca8152 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca814b expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.989405:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.989444:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f480031400/0xa13e120d54ca8152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca814b expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.989457:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f480031400/0xa13e120d54ca8152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca814b expref: 16 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587701.989470:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043854080:0@lo:104: 00000100:00100000:1.0:1788587701.989530:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587701.989584:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f481668800/0xa13e120d54ca811a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca8113 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.989592:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f481668800/0xa13e120d54ca811a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca8113 expref: 16 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587701.989599:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043854208:0@lo:104: 00010000:00010000:1.0:1788587701.989622:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f481539c00/0xa13e120d54ca80fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca80f7 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.989638:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f481539c00/0xa13e120d54ca80fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca80f7 expref: 16 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587701.989647:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043854336:0@lo:104: 00010000:00010000:1.0:1788587701.989673:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4c21d4600/0xa13e120d54ca80d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca80cd expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.989680:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f4c21d4600/0xa13e120d54ca80d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca80cd expref: 16 pid: 5835 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587701.989687:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043854464:0@lo:104: 00010000:00010000:1.0:1788587701.989706:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f480031a00/0xa13e120d54ca80aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca80a3 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587701.989711:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1788587701.989714:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f480031a00/0xa13e120d54ca80aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca80a3 expref: 16 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587701.989720:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043854592:0@lo:104: 00000100:00100000:0.0:1788587701.989728:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587701.989797:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587701.990192:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587701.990215:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043854080 00000100:00100000:3.0:1788587701.990231:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043854080 00000100:00100000:3.0:1788587701.990265:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043854208 00000100:00100000:3.0:1788587701.990268:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043854208 00000100:00100000:3.0:1788587701.990277:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043854336 00000100:00100000:3.0:1788587701.990279:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043854336 00000100:00100000:3.0:1788587701.990305:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587701.990313:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+5:5835:x1875470043854080:12345-0@lo:104: 00010000:00010000:3.0:1788587701.990327:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8152 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587701.990381:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587701.990388:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+5:5835:x1875470043854080:12345-0@lo:104: Request processed in 76us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587701.990395:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587701.990429:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587701.990436:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1941f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+4:5835:x1875470043854208:12345-0@lo:104: 00010000:00010000:3.0:1788587701.990444:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca811a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587701.990475:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788587701.990480:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1941f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+4:5835:x1875470043854208:12345-0@lo:104: Request processed in 46us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587701.990486:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587701.990496:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587701.990502:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1940000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:5835:x1875470043854336:12345-0@lo:104: 00010000:00010000:3.0:1788587701.990518:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca80fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587701.990542:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788587701.990546:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1940000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:5835:x1875470043854336:12345-0@lo:104: Request processed in 45us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587701.990551:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788587701.990604:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788587701.990610:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8152 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990617:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c21d5600 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:1.0:1788587701.990621:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca8152 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990629:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca8152 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587701.990646:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca8152 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587701.990651:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788587701.990685:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8152 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990692:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587701.990711:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8152 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990718:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5600/0xa13e120d54ca814b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8152 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990731:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587701.990734:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca811a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990739:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669400 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:1.0:1788587701.990742:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca811a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990749:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca811a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587701.990755:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca811a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587701.990760:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788587701.990788:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca811a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990794:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587701.990799:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca811a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990806:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481669400/0xa13e120d54ca8113 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca811a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990816:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587701.990819:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca80fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990825:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669600 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:1.0:1788587701.990828:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca80fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990834:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca80fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587701.990863:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca80fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587701.990869:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788587701.990881:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca80fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990886:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587701.990899:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca80fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990915:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca80f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca80fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.990925:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587701.990927:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587701.990928:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587701.990934:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587701.990946:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043854720:0@lo:103: 00000100:00100000:1.0:1788587701.990979:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587701.991010:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587701.991015:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043854848:0@lo:103: 00000100:00100000:1.0:1788587701.991035:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587701.991061:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043854976:0@lo:103: 00000100:00100000:1.0:1788587701.991080:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587701.991111:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043854720 00000100:00100000:1.0:1788587701.991115:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043854720 00010000:00010000:1.0:1788587701.991132:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f480031400/0xa13e120d54ca8152 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca814b expref: 17 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587701.991152:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043854848 00000100:00100000:1.0:1788587701.991154:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043854848 00010000:00010000:1.0:1788587701.991164:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f481668800/0xa13e120d54ca811a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8113 expref: 18 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587701.991173:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043854976 00000100:00100000:1.0:1788587701.991175:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043854976 00010000:00010000:1.0:1788587701.991184:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f481539c00/0xa13e120d54ca80fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca80f7 expref: 19 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587701.991209:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587701.991215:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043854720:12345-0@lo:103: 00010000:00010000:1.0:1788587701.991224:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587701.991230:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f480031400/0xa13e120d54ca8152 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca814b expref: 19 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.991240:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f480031400/0xa13e120d54ca8152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca814b expref: 19 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.991255:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587701.991294:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043854720:12345-0@lo:103: Request processed in 68us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587701.991300:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587701.991315:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587701.991321:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:3302:x1875470043854848:12345-0@lo:103: 00010000:00010000:1.0:1788587701.991328:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587701.991332:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f481668800/0xa13e120d54ca811a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8113 expref: 18 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.991340:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f481668800/0xa13e120d54ca811a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca8113 expref: 18 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.991350:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587701.991370:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:3302:x1875470043854848:12345-0@lo:103: Request processed in 50us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587701.991376:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587701.991387:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788587701.991399:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:3304:x1875470043854976:12345-0@lo:103: 00010000:00010000:1.0:1788587701.991406:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587701.991411:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f481539c00/0xa13e120d54ca80fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca80f7 expref: 17 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.991419:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f481539c00/0xa13e120d54ca80fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca80f7 expref: 17 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.991427:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587701.991452:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:3304:x1875470043854976:12345-0@lo:103: Request processed in 54us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587701.991458:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788587701.991496:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043854976:0@lo:103: 00000100:00100000:1.0:1788587701.991517:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043854848:0@lo:103: 00000100:00100000:1.0:1788587701.991523:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043854720:0@lo:103: 00000100:00100000:2.0:1788587701.992352:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7f06c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788587701.992372:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f480031400/0xa13e120d54ca8152 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca814b expref: 16 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587701.992383:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043854080:0@lo:104: 00010000:00010000:2.0:1788587701.992394:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481668800/0xa13e120d54ca811a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca8113 expref: 15 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587701.992402:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043854208:0@lo:104: 00010000:00010000:2.0:1788587701.992411:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481539c00/0xa13e120d54ca80fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca80f7 expref: 14 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587701.992417:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043854336:0@lo:104: 00000100:00100000:0.0:1788587701.992468:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587701.992537:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043854592 00000100:00100000:3.0:1788587701.992542:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043854592 00000100:00100000:3.0:1788587701.992567:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043854464 00000100:00100000:3.0:1788587701.992570:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043854464 00000100:00100000:3.0:1788587701.992584:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587701.992591:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+4:5835:x1875470043854592:12345-0@lo:104: 00010000:00010000:3.0:1788587701.992602:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f480031200/0xa13e120d54ca80a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca80aa expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587701.992663:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587701.992668:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+4:5835:x1875470043854592:12345-0@lo:104: Request processed in 79us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587701.992676:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587701.992691:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587701.992697:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1943800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:5835:x1875470043854464:12345-0@lo:104: 00010000:00010000:3.0:1788587701.992705:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca80d4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587701.992735:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788587701.992739:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1943800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:5835:x1875470043854464:12345-0@lo:104: Request processed in 44us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587701.992760:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788587701.992884:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587701.992890:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f480031200/0xa13e120d54ca80a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca80aa expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.992897:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031200 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:1.0:1788587701.992901:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f480031200/0xa13e120d54ca80a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca80aa expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.992909:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f480031200/0xa13e120d54ca80a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca80aa expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587701.992916:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f480031200/0xa13e120d54ca80a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca80aa expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587701.992932:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788587701.992963:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f480031200/0xa13e120d54ca80a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca80aa expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.992970:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587701.992987:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f480031200/0xa13e120d54ca80a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca80aa expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.992994:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f480031200/0xa13e120d54ca80a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca80aa expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993004:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587701.993008:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca80d4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993013:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c21d4800 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:1.0:1788587701.993016:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca80d4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993022:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca80d4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587701.993027:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca80d4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587701.993031:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788587701.993042:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca80d4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993047:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587701.993064:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca80d4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993071:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f4c21d4800/0xa13e120d54ca80cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca80d4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993086:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587701.993088:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587701.993089:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587701.993103:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043855104:0@lo:103: 00000100:00100000:1.0:1788587701.993134:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587701.993161:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587701.993168:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043855232:0@lo:103: 00000100:00100000:1.0:1788587701.993200:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587701.993237:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043855104 00000100:00100000:1.0:1788587701.993241:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043855104 00010000:00010000:1.0:1788587701.993257:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f480031a00/0xa13e120d54ca80aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca80a3 expref: 14 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587701.993273:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043855232 00000100:00100000:1.0:1788587701.993276:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043855232 00010000:00010000:1.0:1788587701.993293:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4c21d4600/0xa13e120d54ca80d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca80cd expref: 15 pid: 5835 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587701.993308:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788587701.993313:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:3305:x1875470043855104:12345-0@lo:103: 00010000:00010000:1.0:1788587701.993322:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587701.993326:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f480031a00/0xa13e120d54ca80aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca80a3 expref: 15 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993344:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f480031a00/0xa13e120d54ca80aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca80a3 expref: 15 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993356:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587701.993381:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:3305:x1875470043855104:12345-0@lo:103: Request processed in 68us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587701.993387:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788587701.993402:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788587701.993408:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:3303:x1875470043855232:12345-0@lo:103: 00010000:00010000:1.0:1788587701.993414:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587701.993418:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4c21d4600/0xa13e120d54ca80d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca80cd expref: 14 pid: 5835 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993427:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4c21d4600/0xa13e120d54ca80d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca80cd expref: 14 pid: 5835 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993438:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993446:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993459:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993465:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993472:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993484:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993489:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481668a00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587701.993493:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993501:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993509:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587701.993518:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587701.993545:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:3303:x1875470043855232:12345-0@lo:103: Request processed in 137us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587701.993551:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788587701.993583:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043855232:0@lo:103: 00000100:00100000:1.0:1788587701.993605:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043855104:0@lo:103: 00010000:00010000:1.0:1788587701.993620:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587701.993898:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4c21d4600/0xa13e120d54ca80d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca80cd expref: 13 pid: 5835 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587701.993916:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043854464:0@lo:104: 00010000:00010000:2.0:1788587701.993928:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f480031a00/0xa13e120d54ca80aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca80a3 expref: 12 pid: 5834 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587701.993937:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1875470043854592:0@lo:104: 00010000:00010000:2.0:1788587701.993959:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587701.993968:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587701.993973:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587701.993979:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481668a00/0xa13e120d54ca8167 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788587701.993992:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788587702.024733:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043853952:0@lo:253: 10000000:01000000:1.0:1788587702.024750:0:7631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788587702.024754:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788587702.024755:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788587702.024757:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587702.024758:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788587702.024759:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587702.024761:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587702.024773:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587702.024774:0:7631:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788587702.024776:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587702.024778:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788587702.024807:0:7631:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88f4b487a800 from lustre-OST0001 10000000:01000000:1.0:1788587702.024829:0:7631:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788587702.024832:0:7631:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788587702.024862:0:7631:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88f48709cd40 local copy 10000000:01000000:1.0:1788587702.024866:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788587702.024899:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.024909:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.024919:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587702.024964:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:7631:x1875470043853952:12345-0@lo:253: Request processed in 45432us (45702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587702.024975:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788587702.025048:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043855360:0@lo:101: 00000100:00100000:1.0:1788587702.025083:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587702.025156:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7f0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587702.025380:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043855360 00000100:00100000:0.0:1788587702.025387:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043855360 00000100:00100000:0.0:1788587702.025464:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788587702.025474:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:7631:x1875470043855360:12345-0@lo:101: 00010000:00010000:0.0:1788587702.025486:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587702.025498:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f480031800/0xa13e120d54ca8175 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca816e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587702.025533:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f480031800/0xa13e120d54ca8175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca816e expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587702.025543:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f480031800/0xa13e120d54ca8175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca816e expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587702.025552:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031800, rc 0) 00000100:00100000:0.0:1788587702.025597:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:7631:x1875470043855360:12345-0@lo:101: Request processed in 125us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587702.025603:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788587702.025673:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043855360:0@lo:101: 00010000:00010000:2.0:1788587702.025685:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa13e120d54ca8175 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587702.025695:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa13e120d54ca8175 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587702.025798:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa53100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043855488:0@lo:501: 00000100:00100000:2.0:1788587702.025827:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587702.026054:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486589780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587702.026124:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043855488 00000100:00100000:1.0:1788587702.026129:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043855488 00000100:00100000:1.0:1788587702.026166:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788587702.026174:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:7631:x1875470043855488:12345-0@lo:501: 00000100:00100000:1.0:1788587702.026393:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:7631:x1875470043855488:12345-0@lo:501: Request processed in 219us (565us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587702.026400:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788587702.026476:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa53100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043855488:0@lo:501: 10000000:01000000:2.0:1788587702.026489:0:7631:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788587702.026514:0:7631:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788587702.026519:0:7631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa13e120d54ca8175 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587702.026528:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa13e120d54ca8175 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587702.026535:0:7631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa13e120d54ca8175 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587702.026555:0:7631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788587702.026573:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88f4b487a800 10000000:01000000:2.0:1788587702.026578:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788587702.026582:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788587702.026585:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788587702.026589:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788587702.026591:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788587702.026608:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587702.026616:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587702.026624:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587702.026636:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa53100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043855616:0@lo:101: 00000100:00100000:2.0:1788587702.026667:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587702.026681:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486589480 going to sleep for 11 seconds 00010000:00010000:1.0:1788587702.026735:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587702.026740:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa13e120d54ca8175 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.026759:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669600 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:1.0:1788587702.026763:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa13e120d54ca8175 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.026771:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa13e120d54ca8175 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587702.026790:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa13e120d54ca8175 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587702.026796:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788587702.026813:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13e120d54ca8175 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.026819:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587702.026863:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13e120d54ca8175 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.026870:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca816e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13e120d54ca8175 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.026883:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587702.026885:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587702.026887:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587702.026893:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587702.026903:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043855744:0@lo:103: 00000100:00100000:1.0:1788587702.026930:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587702.026960:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043855616 00000100:00100000:1.0:1788587702.026964:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043855616 00000100:00100000:1.0:1788587702.026990:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788587702.026996:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:7631:x1875470043855616:12345-0@lo:101: 00010000:00010000:1.0:1788587702.027003:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587702.027012:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f481669400/0xa13e120d54ca8183 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca817c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.027028:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f481669400/0xa13e120d54ca8183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca817c expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.027037:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f481669400/0xa13e120d54ca8183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca817c expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.027044:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481669400, rc 0) 00000100:00100000:1.0:1788587702.027073:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:7631:x1875470043855616:12345-0@lo:101: Request processed in 77us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587702.027079:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788587702.027102:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043855744 00000100:00100000:1.0:1788587702.027105:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043855744 00000100:00100000:1.0:1788587702.027129:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587702.027135:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:3302:x1875470043855744:12345-0@lo:103: 00010000:00010000:1.0:1788587702.027143:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587702.027154:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f480031800/0xa13e120d54ca8175 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca816e expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.027163:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587702.027188:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:3302:x1875470043855744:12345-0@lo:103: Request processed in 53us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587702.027193:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587702.027219:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043855744:0@lo:103: 00000100:00100000:1.0:1788587702.027250:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa53100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043855616:0@lo:101: 00010000:00010000:1.0:1788587702.027262:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8183 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.027270:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca8183 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587702.027345:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043855872:0@lo:501: 00000100:00100000:1.0:1788587702.027371:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587702.027385:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7f0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587702.027398:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043855872 00000100:00100000:1.0:1788587702.027401:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043855872 00000100:00100000:1.0:1788587702.027418:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788587702.027424:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:7631:x1875470043855872:12345-0@lo:501: 00000100:00100000:1.0:1788587702.027583:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:7631:x1875470043855872:12345-0@lo:501: Request processed in 158us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587702.027590:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788587702.027620:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043855872:0@lo:501: 00000100:00100000:1.0:1788587702.027643:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856000:0@lo:503: 00000100:00100000:1.0:1788587702.027679:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587702.027692:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7f0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587702.027703:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043856000 00000100:00100000:1.0:1788587702.027706:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043856000 00000100:00100000:1.0:1788587702.027722:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587702.027727:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:7631:x1875470043856000:12345-0@lo:503: 00000100:00100000:1.0:1788587702.027886:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:7631:x1875470043856000:12345-0@lo:503: Request processed in 158us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587702.027898:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587702.027933:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856000:0@lo:503: 00000040:00080000:1.0:1788587702.028190:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587702.028241:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856128:0@lo:502: 00000100:00100000:1.0:1788587702.028274:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587702.028309:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7f0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587702.028324:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043856128 00000100:00100000:1.0:1788587702.028328:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043856128 00000100:00100000:1.0:1788587702.028359:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788587702.028365:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:7631:x1875470043856128:12345-0@lo:502: 00000100:00100000:1.0:1788587702.029302:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:7631:x1875470043856128:12345-0@lo:502: Request processed in 935us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587702.029309:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788587702.029572:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856128:0@lo:502: 00000040:00080000:3.0:1788587702.030232:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788587702.030297:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788587702.030328:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788587702.031530:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788587702.031579:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788587702.031618:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788587702.031662:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856256:0@lo:502: 00000100:00100000:3.0:1788587702.031735:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587702.031776:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49fadc540 going to sleep for 11 seconds 00000100:00100000:0.0:1788587702.031829:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043856256 00000100:00100000:0.0:1788587702.031837:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043856256 00000100:00100000:0.0:1788587702.031911:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788587702.031920:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:7631:x1875470043856256:12345-0@lo:502: 00000100:00100000:0.0:1788587702.032097:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:7631:x1875470043856256:12345-0@lo:502: Request processed in 177us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587702.032105:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788587702.032188:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856256:0@lo:502: 00000040:00080000:3.0:1788587702.032274:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788587702.032296:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788587702.034946:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788587702.034957:0:7639:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788587702.034964:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587702.034966:0:7639:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788587702.034973:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788587702.035695:0:7639:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff88f4bfb3b380) 00000020:00000080:0.0:1788587702.035719:0:7639:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788587702.035729:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788587702.036198:0:7639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88f4b487a800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788587702.036207:0:7639:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788587702.036214:0:7639:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa13e120d54ca8191 00010000:00010000:0.0:1788587702.041450:0:7639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788587702.041904:0:7639:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788587702.047205:0:7639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788587702.048543:0:7639:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788587702.052217:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788587702.052669:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788587702.054055:0:7639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788587702.054066:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587702.054072:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587702.054073:0:7639:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788587702.054077:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587702.054080:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587702.054081:0:7639:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788587702.054084:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788587702.054086:0:7639:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788587702.054126:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587702.054129:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587702.054130:0:7639:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788587702.054138:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788587702.054314:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788587702.054340:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788587702.054362:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8183 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.054383:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8183 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587702.054392:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f4b487a800 from 1 10000000:01000000:3.0:1788587702.054395:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587702.054424:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.054433:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.054454:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587702.054629:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856384:0@lo:101: 00000100:00100000:3.0:1788587702.054687:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587702.054727:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49fadc540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587702.054796:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043856384 00000100:00100000:1.0:1788587702.054803:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043856384 00000100:00100000:1.0:1788587702.054866:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788587702.054875:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:7631:x1875470043856384:12345-0@lo:101: 00010000:00010000:1.0:1788587702.054887:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587702.054898:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f481669600/0xa13e120d54ca819f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.054916:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f481669600/0xa13e120d54ca819f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8198 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.054925:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f481669600/0xa13e120d54ca819f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8198 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.054933:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481669600, rc 0) 00000100:00100000:1.0:1788587702.054970:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:7631:x1875470043856384:12345-0@lo:101: Request processed in 96us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587702.054977:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788587702.055164:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856384:0@lo:101: 00010000:00010000:0.0:1788587702.055187:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca819f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587702.055196:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca819f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587702.055635:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1941500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856512:0@lo:501: 00000100:00100000:0.0:1788587702.055667:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587702.055700:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4afd7acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587702.055879:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043856512 00000100:00100000:1.0:1788587702.055884:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043856512 00000100:00100000:1.0:1788587702.055907:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788587702.055913:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:7631:x1875470043856512:12345-0@lo:501: 00000100:00100000:1.0:1788587702.056125:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:7631:x1875470043856512:12345-0@lo:501: Request processed in 211us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587702.056132:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788587702.056721:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1941500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856512:0@lo:501: 00000100:00100000:2.0:1788587702.056762:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856640:0@lo:503: 00000100:00100000:2.0:1788587702.056806:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587702.056870:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486589780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587702.056895:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043856640 00000100:00100000:1.0:1788587702.056901:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043856640 00000100:00100000:1.0:1788587702.056933:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788587702.056948:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:7631:x1875470043856640:12345-0@lo:503: 00000100:00100000:1.0:1788587702.057605:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:7631:x1875470043856640:12345-0@lo:503: Request processed in 657us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587702.057613:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788587702.057834:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856640:0@lo:503: 00000040:00080000:2.0:1788587702.058124:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788587702.058186:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856768:0@lo:502: 00000100:00100000:2.0:1788587702.058620:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587702.058659:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486589780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587702.058753:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043856768 00000100:00100000:0.0:1788587702.058759:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043856768 00000100:00100000:0.0:1788587702.058799:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788587702.058806:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:7631:x1875470043856768:12345-0@lo:502: 00000100:00100000:0.0:1788587702.059003:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:7631:x1875470043856768:12345-0@lo:502: Request processed in 196us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587702.059009:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788587702.059300:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856768:0@lo:502: 00000040:00080000:2.0:1788587702.059662:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788587702.059737:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788587702.059765:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856896:0@lo:502: 00000100:00100000:2.0:1788587702.059805:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587702.059838:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486589780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587702.059883:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043856896 00000100:00100000:3.0:1788587702.059889:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043856896 00000100:00100000:3.0:1788587702.059918:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788587702.059924:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:7631:x1875470043856896:12345-0@lo:502: 00000100:00100000:3.0:1788587702.060043:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:7631:x1875470043856896:12345-0@lo:502: Request processed in 118us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587702.060050:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788587702.060059:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043856896:0@lo:502: 00000040:00080000:0.0:1788587702.060134:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788587702.060143:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788587702.061089:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587702.061098:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587702.061100:0:7643:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788587702.061107:0:7643:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88f4b487a800 00000020:00000080:3.0:1788587702.061109:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587702.061129:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587702.061133:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587702.061135:0:7643:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788587702.061138:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788587702.061826:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788587702.061955:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587702.062128:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca819f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.062140:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca819f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587702.062193:0:7631:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788587702.062196:0:7631:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88f4b487a800 10000000:01000000:1.0:1788587702.062199:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88f4b487a800 10000000:01000000:1.0:1788587702.062203:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788587702.062208:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88f4b487a800 from 1 10000000:01000000:1.0:1788587702.062210:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788587702.062238:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.062246:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587702.062255:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587702.062274:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043857024:0@lo:101: 00000100:00100000:1.0:1788587702.062332:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587702.062380:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7f0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587702.062492:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043857024 00000100:00100000:0.0:1788587702.062499:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043857024 00000100:00100000:0.0:1788587702.062539:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788587702.062548:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:7631:x1875470043857024:12345-0@lo:101: 00010000:00010000:0.0:1788587702.062558:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587702.062575:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f480030200/0xa13e120d54ca81ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca81a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587702.062597:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f480030200/0xa13e120d54ca81ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca81a6 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587702.062608:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f480030200/0xa13e120d54ca81ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca81a6 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587702.062615:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030200, rc 0) 00000100:00100000:0.0:1788587702.062664:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:7631:x1875470043857024:12345-0@lo:101: Request processed in 118us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587702.062671:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788587702.062788:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043857024:0@lo:101: 00010000:00010000:2.0:1788587702.062801:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca81ad expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587702.062810:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca81ad expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587702.062930:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043857152:0@lo:501: 00000100:00100000:2.0:1788587702.062954:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587702.062970:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4865890c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587702.063060:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043857152 00000100:00100000:1.0:1788587702.063063:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043857152 00000100:00100000:1.0:1788587702.063083:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788587702.063089:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:7631:x1875470043857152:12345-0@lo:501: 00000100:00100000:1.0:1788587702.063317:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:7631:x1875470043857152:12345-0@lo:501: Request processed in 226us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587702.063323:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788587702.063355:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043857152:0@lo:501: 00000100:00100000:1.0:1788587702.063378:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043857280:0@lo:503: 00000100:00100000:1.0:1788587702.063410:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587702.063430:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043857280 00000100:00100000:1.0:1788587702.063433:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043857280 00000100:00100000:1.0:1788587702.063452:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788587702.063458:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:7631:x1875470043857280:12345-0@lo:503: 00000100:00100000:1.0:1788587702.063577:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:7631:x1875470043857280:12345-0@lo:503: Request processed in 119us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587702.063584:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788587702.063617:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7f0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587702.063629:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043857280:0@lo:503: 00000040:00080000:1.0:1788587702.063833:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587702.063912:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043857408:0@lo:502: 00000100:00100000:1.0:1788587702.063941:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587702.063960:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043857408 00000100:00100000:1.0:1788587702.063963:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043857408 00000100:00100000:1.0:1788587702.063981:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788587702.064122:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:7631:x1875470043857408:12345-0@lo:502: 00000100:00100000:1.0:1788587702.064337:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:7631:x1875470043857408:12345-0@lo:502: Request processed in 217us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587702.064344:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788587702.064381:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7f0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587702.064394:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043857408:0@lo:502: 00000040:00080000:1.0:1788587702.064618:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788587702.064664:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788587702.064697:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788587702.064743:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788587702.064777:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788587702.064818:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788587702.064876:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788587702.064907:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788587702.064956:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788587702.065252:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788587702.065318:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788587702.065368:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788587702.065401:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788587702.065432:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788587702.065478:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788587702.065514:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788587702.065548:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788587702.065595:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788587702.065630:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788587702.065663:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788587702.065704:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788587702.065734:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788587702.065763:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788587702.065814:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788587702.066109:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788587702.066146:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788587702.066280:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788587702.066324:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788587702.066353:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788587702.066405:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788587702.066439:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788587702.066471:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788587702.066505:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788587702.066553:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788587702.066589:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788587702.066634:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788587702.066671:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788587702.066710:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043857536:0@lo:502: 00000100:00100000:1.0:1788587702.066771:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587702.066891:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7f0300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587702.067036:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043857536 00000100:00100000:2.0:1788587702.067043:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043857536 00000100:00100000:2.0:1788587702.067119:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788587702.067129:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:7631:x1875470043857536:12345-0@lo:502: 00000100:00100000:2.0:1788587702.067351:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:7631:x1875470043857536:12345-0@lo:502: Request processed in 223us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587702.067359:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788587702.067444:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043857536:0@lo:502: 00000040:00080000:3.0:1788587702.067515:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788587702.067526:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788587702.068183:0:7644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788587702.068196:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88f48569b380) 00000020:00000080:3.0:1788587702.068216:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788587702.068307:0:7644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88f4b487a800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788587702.068311:0:7644:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88f4b487a800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788587702.068314:0:7644:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88f4b487a800 3 00010000:00080000:3.0:1788587702.068340:0:7644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88f4bfb0c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.133@tcp at head 00010000:00010000:3.0:1788587702.070247:0:7644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788587702.070480:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788587702.070510:0:7644:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788587702.070520:0:7644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa13e120d54ca81bb 00000100:00080000:3.0:1788587702.070529:0:7644:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587702.070534:0:7644:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88f4bfb0c800 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:3.0:1788587702.070565:0:7644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f4b4806d80 x1875470043857664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587702.070596:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875470043857664:0@lo:38: 00000100:00100000:3.0:1788587702.070654:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587702.070712:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043857664 00000100:00100000:3.0:1788587702.070718:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043857664 00000100:00100000:3.0:1788587702.070745:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587702.070751:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875470043857664:12345-0@lo:38: 00010000:00080000:3.0:1788587702.070771:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:3.0:1788587702.070797:0:5841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa13e120d54ca81c2 00000004:00100000:3.0:1788587702.070811:0:5841:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788587702.070837:0:5841:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb0e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587702.070902:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875470043857664:12345-0@lo:38: Request processed in 149us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587702.070909:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788587702.070944:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4b4806d80 x1875470043857664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587702.070968:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788587702.070974:0:3301:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788587702.070980:0:3301:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788587702.071053:0:3301:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788587702.071055:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb0c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788587702.071061:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875470043857664:0@lo:38: 00000100:00080000:3.0:1788587702.071079:0:7644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788587702.071220:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043857792:0@lo:400: 00000100:00100000:3.0:1788587702.071250:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587702.071271:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587702.071277:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043857920:0@lo:400: 00000100:00100000:3.0:1788587702.071310:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587702.071344:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043858048:0@lo:400: 00000100:00100000:3.0:1788587702.071369:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587702.071485:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043857792 00000100:00100000:3.0:1788587702.071494:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043857792 00000100:00100000:3.0:1788587702.071562:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043857920 00000100:00100000:3.0:1788587702.071566:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043857920 00000100:00100000:1.0:1788587702.071646:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788587702.071655:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043857792:12345-0@lo:400: 00000100:00100000:3.0:1788587702.071706:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788587702.071707:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043857792:12345-0@lo:400: Request processed in 54us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587702.071713:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587702.071714:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043857920:12345-0@lo:400: 00000100:00100000:3.0:1788587702.071747:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043857920:12345-0@lo:400: Request processed in 30us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587702.071753:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788587702.071780:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4b4806a00 x1875470043857920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587702.071791:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043857920:0@lo:400: 00010000:00080000:2.0:1788587702.071801:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4b4806d80 x1875470043857792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587702.071809:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043857792:0@lo:400: 00000100:00100000:0.0:1788587702.071955:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043858048 00000100:00100000:0.0:1788587702.071959:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043858048 00000100:00100000:0.0:1788587702.071994:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587702.072002:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043858048:12345-0@lo:400: 00000100:00100000:0.0:1788587702.072044:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043858048:12345-0@lo:400: Request processed in 43us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587702.072050:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788587702.072245:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4b4804e00 x1875470043858048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587702.072336:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043858048:0@lo:400: 00000040:00080000:1.0:1788587702.072337:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1788587702.072478:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa52a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7645:1875470043858176:0@lo:901: 00000100:00100000:2.0:1788587702.072512:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587702.072565:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486589000 going to sleep for 11 seconds 00000020:01000000:3.0:1788587702.072595:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:1.0:1788587702.072605:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043858176 00000100:00100000:1.0:1788587702.072609:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043858176 10000000:01000000:3.0:1788587702.072620:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788587702.072635:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca81ad expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.072645:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca81ad expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587702.072678:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587702.072685:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1875470043858176:12345-0@lo:901: 00000020:01000004:3.0:1788587702.072700:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788587702.072702:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587702.072703:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587702.072704:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587702.072705:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587702.072706:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587702.072707:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587702.072708:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788587702.072710:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788587702.072711:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587702.072712:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587702.072716:0:7631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788587702.072718:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587702.072719:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587702.072720:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587702.072721:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587702.072722:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587702.072723:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587702.072724:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587702.072725:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788587702.072726:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788587702.072726:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587702.072727:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587702.072739:0:7631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788587702.072746:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4804e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043858304:0@lo:253: 00000100:00100000:3.0:1788587702.072782:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587702.072886:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043858304 00000100:00100000:0.0:1788587702.072891:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043858304 00000100:00100000:0.0:1788587702.072914:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788587702.072919:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:7631:x1875470043858304:12345-0@lo:253: 20000000:01000000:0.0:1788587702.072937:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788587702.072950:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788587702.073073:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1875470043858176:12345-0@lo:901: Request processed in 388us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587702.073080:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788587702.073113:0:7645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4baa52a00 x1875470043858176/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788587718 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587702.073133:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa52a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7645:1875470043858176:0@lo:901: 00000100:00080000:2.0:1788587702.073343:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587702.074921:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49fadc480 going to sleep for 11 seconds 20000000:01000000:1.0:1788587702.097374:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788587702.097391:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788587702.099005:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788587702.099012:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788587702.099033:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587702.099065:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f481668200/0xa13e120d54ca810c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8105 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587702.099073:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587702.099112:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f481668200/0xa13e120d54ca810c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca8105 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587702.099125:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f481668200/0xa13e120d54ca810c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca8105 expref: 14 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587702.099138:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875470043858432:0@lo:104: 00000100:00100000:2.0:1788587702.099270:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587702.099316:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486688b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587702.099520:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043858432 00000100:00100000:3.0:1788587702.099527:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043858432 00000100:00100000:3.0:1788587702.099577:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587702.099585:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:5857:x1875470043858432:12345-0@lo:104: 00010000:00010000:3.0:1788587702.099597:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca810c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.099644:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587702.099650:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:5857:x1875470043858432:12345-0@lo:104: Request processed in 66us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587702.099657:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788587702.099675:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587702.099681:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca810c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.099687:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481539400 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:3.0:1788587702.099691:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca810c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.099699:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca810c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587702.099706:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca810c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587702.099712:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587702.099737:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca810c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.099751:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587702.099766:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca810c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.099772:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca8105 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca810c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.099799:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587702.099802:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587702.099803:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587702.099821:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043858560:0@lo:103: 00000100:00100000:3.0:1788587702.099875:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587702.099908:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043858560 00000100:00100000:3.0:1788587702.099913:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043858560 00010000:00010000:3.0:1788587702.099928:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f481668200/0xa13e120d54ca810c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8105 expref: 15 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587702.099949:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587702.099955:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485c35450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:3303:x1875470043858560:12345-0@lo:103: 00010000:00010000:3.0:1788587702.099964:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587702.099968:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f481668200/0xa13e120d54ca810c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8105 expref: 15 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.099978:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f481668200/0xa13e120d54ca810c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca8105 expref: 15 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.099993:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.100009:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788587702.100022:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001331185s 00010000:00010000:3.0:1788587702.100026:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.100033:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.100039:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.100045:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.100050:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481539600 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:3.0:1788587702.100054:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.100061:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.100069:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587702.100078:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587702.100106:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485c35450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:3303:x1875470043858560:12345-0@lo:103: Request processed in 151us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587702.100112:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788587702.100458:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481668200/0xa13e120d54ca810c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca8105 expref: 14 pid: 5836 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587702.100469:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875470043858432:0@lo:104: 00010000:00010000:2.0:1788587702.100484:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587702.100493:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587702.100499:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587702.100504:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481539600/0xa13e120d54ca81c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587702.100650:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043858560:0@lo:103: 00000100:00100000:1.0:1788587702.105421:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:7631:x1875470043858304:12345-0@lo:253: Request processed in 32493us (32630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587702.105434:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788587702.105511:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4804e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:52de7536-38dc-49e6-9b51-4cdaba805a7b:7631:1875470043858304:0@lo:253: 10000000:01000000:3.0:1788587702.105524:0:7631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788587702.105527:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788587702.105529:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587702.105530:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587702.105532:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587702.105533:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587702.105535:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587702.105536:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587702.105538:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788587702.105539:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788587702.105541:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587702.105542:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788587702.105555:0:7631:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788587702.110729:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587702.111128:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587702.111426:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587702.111601:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587702.111809:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587702.112061:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788587702.113590:0:7631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788587702.250115:0:7631:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788587702.250123:0:7631:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788587702.250153:0:7631:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788587702.250346:0:7631:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.133@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788587702.250371:0:7631:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788587702.250394:0:7631:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788587702.728081:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587703.752055:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587704.780826:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587705.803049:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587706.312217:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043858688:0@lo:13: 00000100:00100000:3.0:1788587706.312295:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587706.312739:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043858688 00000100:00100000:0.0:1788587706.312748:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043858688 00000100:00100000:0.0:1788587706.312824:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587706.312835:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043858688:12345-0@lo:13: 00000100:00080000:3.0:1788587706.312941:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788587706.313121:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587706.313317:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043858688:12345-0@lo:13: Request processed in 483us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587706.313326:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788587706.314324:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4c1940380 x1875470043858688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587706.314347:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043858688:0@lo:13: 00010000:00010000:3.0:1788587706.824960:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587707.341295:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043858816:0@lo:400: 00000100:00100000:0.0:1788587707.341359:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.341405:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043859328:0@lo:400: 00000100:00100000:0.0:1788587707.341431:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.341455:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587707.341460:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043859200:0@lo:400: 00000100:00100000:0.0:1788587707.341481:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.341505:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043858944:0@lo:400: 00000100:00100000:0.0:1788587707.341524:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.341539:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587707.341544:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043859072:0@lo:400: 00000100:00100000:0.0:1788587707.341561:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.341586:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043859200 00000100:00100000:0.0:1788587707.341593:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043859200 00000100:00100000:0.0:1788587707.341632:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587707.341639:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043859200:12345-0@lo:400: 00000100:00100000:0.0:1788587707.341682:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043859200:12345-0@lo:400: Request processed in 43us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587707.341699:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587707.341721:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043859328 00000100:00100000:0.0:1788587707.341725:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043859328 00000100:00100000:0.0:1788587707.341751:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043858944 00000100:00100000:0.0:1788587707.341754:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043858944 00000100:00100000:0.0:1788587707.341764:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043859072 00000100:00100000:0.0:1788587707.341766:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043859072 00000100:00100000:0.0:1788587707.341778:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587707.341784:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043859328:12345-0@lo:400: 00000100:00100000:0.0:1788587707.341811:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043859328:12345-0@lo:400: Request processed in 27us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587707.341817:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587707.341827:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788587707.341833:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043858944:12345-0@lo:400: 00000100:00100000:0.0:1788587707.341887:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043858944:12345-0@lo:400: Request processed in 53us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587707.341892:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788587707.341903:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788587707.341909:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043859072:12345-0@lo:400: 00000100:00100000:0.0:1788587707.341930:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043859072:12345-0@lo:400: Request processed in 22us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587707.342005:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788587707.342028:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788587707.342056:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4c1940e00 x1875470043859072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587707.342069:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043859072:0@lo:400: 00010000:00080000:0.0:1788587707.342088:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4c1943b80 x1875470043858944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587707.342096:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043858944:0@lo:400: 00010000:00080000:0.0:1788587707.342121:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4c1942a00 x1875470043859200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587707.342129:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043859200:0@lo:400: 00010000:00080000:0.0:1788587707.342137:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4c1943100 x1875470043859328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587707.342144:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043859328:0@lo:400: 10000000:01000000:1.0:1788587707.342276:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788587707.342280:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88f4baee9800 from 30 10000000:01000000:1.0:1788587707.342284:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788587707.342312:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587707.342322:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587707.342332:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587707.342348:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043859456:0@lo:101: 00000100:00100000:1.0:1788587707.342378:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587707.342392:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7136c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587707.342446:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043858816 00000100:00100000:0.0:1788587707.342450:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043858816 00000100:00100000:0.0:1788587707.342479:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043859456 00000100:00100000:0.0:1788587707.342482:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043859456 00000100:00100000:0.0:1788587707.342493:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788587707.342499:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:3305:x1875470043858816:12345-0@lo:400: 00000100:00100000:0.0:1788587707.342533:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:3305:x1875470043858816:12345-0@lo:400: Request processed in 34us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587707.342540:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788587707.342558:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788587707.342564:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:5838:x1875470043859456:12345-0@lo:101: 00010000:00010000:0.0:1788587707.342570:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587707.342580:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f480031400/0xa13e120d54ca81d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca81d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.342598:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f480031400/0xa13e120d54ca81d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca81d0 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.342615:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f480031400/0xa13e120d54ca81d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca81d0 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.342623:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031400, rc 0) 00000100:00100000:0.0:1788587707.342649:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043859456:12345-0@lo:101: Request processed in 86us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587707.342655:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788587707.342778:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043858816:0@lo:400: 00000100:00100000:0.0:1788587707.342798:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043859456:0@lo:101: 00010000:00010000:0.0:1788587707.342809:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca81d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.342818:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca81d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587707.342876:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1942680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043859584:0@lo:501: 00000100:00100000:0.0:1788587707.342899:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.342916:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043859584 00000100:00100000:0.0:1788587707.342919:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043859584 00000100:00100000:2.0:1788587707.343224:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788587707.343236:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043859584:12345-0@lo:501: 00000100:00100000:0.0:1788587707.343531:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486638b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.344160:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043859584:12345-0@lo:501: Request processed in 925us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.344169:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788587707.344240:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1942680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043859584:0@lo:501: 00000100:00100000:0.0:1788587707.344291:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1942680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043859712:0@lo:503: 00000100:00100000:0.0:1788587707.344331:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.344368:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486638b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.344421:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043859712 00000100:00100000:2.0:1788587707.344426:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043859712 00000100:00100000:2.0:1788587707.344713:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788587707.344722:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043859712:12345-0@lo:503: 00000100:00100000:2.0:1788587707.345110:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043859712:12345-0@lo:503: Request processed in 388us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.345116:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788587707.345197:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1942680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043859712:0@lo:503: 00000100:00100000:0.0:1788587707.346462:0:7949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7949:1875470043859840:0@lo:502: 00000100:00100000:0.0:1788587707.346522:0:7949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.346553:0:7949:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486638b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.354148:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043859840 00000100:00100000:2.0:1788587707.354163:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043859840 00000100:00100000:2.0:1788587707.354228:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788587707.354237:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:7949:x1875470043859840:12345-0@lo:502: 00000100:00100000:2.0:1788587707.354588:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:7949:x1875470043859840:12345-0@lo:502: Request processed in 352us (8065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.354596:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788587707.354657:0:7949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7949:1875470043859840:0@lo:502: 00000100:00100000:2.0:1788587707.354719:0:7949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7949:1875470043859968:0@lo:502: 00000100:00100000:2.0:1788587707.354758:0:7949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587707.354779:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043859968 00000100:00100000:2.0:1788587707.354783:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043859968 00000100:00100000:2.0:1788587707.354803:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788587707.354815:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:7949:x1875470043859968:12345-0@lo:502: 00000100:00100000:2.0:1788587707.355166:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:7949:x1875470043859968:12345-0@lo:502: Request processed in 351us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.355174:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788587707.355211:0:7949:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7bb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.355224:0:7949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7949:1875470043859968:0@lo:502: 00000040:00080000:2.0:1788587707.355243:0:7949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788587707.360567:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788587707.360602:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788587707.360614:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca81d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.360627:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca81d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587707.360637:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788587707.360640:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788587707.360643:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788587707.360680:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.360688:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.360699:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587707.360721:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043860096:0@lo:101: 00000100:00100000:0.0:1788587707.360779:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.360825:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486638b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587707.361123:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043860096 00000100:00100000:1.0:1788587707.361131:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043860096 00000100:00100000:1.0:1788587707.361181:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788587707.361190:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043860096:12345-0@lo:101: 00010000:00010000:1.0:1788587707.361202:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587707.361222:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f481669a00/0xa13e120d54ca81e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca81de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587707.361243:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f481669a00/0xa13e120d54ca81e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca81de expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587707.361265:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f481669a00/0xa13e120d54ca81e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca81de expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587707.361274:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481669a00, rc 0) 00000100:00100000:1.0:1788587707.361312:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043860096:12345-0@lo:101: Request processed in 122us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587707.361318:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788587707.361404:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043860096:0@lo:101: 00010000:00010000:0.0:1788587707.361417:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca81e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.361425:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca81e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587707.361477:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043860224:0@lo:501: 00000100:00100000:0.0:1788587707.361501:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.361524:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486638b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.361588:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043860224 00000100:00100000:2.0:1788587707.361593:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043860224 00000100:00100000:2.0:1788587707.361623:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788587707.361630:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043860224:12345-0@lo:501: 00000100:00100000:2.0:1788587707.361874:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043860224:12345-0@lo:501: Request processed in 244us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.361882:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788587707.362027:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043860224:0@lo:501: 00000100:00100000:0.0:1788587707.362054:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043860352:0@lo:503: 00000100:00100000:0.0:1788587707.362089:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.362107:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043860352 00000100:00100000:0.0:1788587707.362111:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043860352 00000100:00100000:0.0:1788587707.362137:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788587707.362143:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043860352:12345-0@lo:503: 00000100:00100000:0.0:1788587707.362402:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043860352:12345-0@lo:503: Request processed in 259us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587707.362409:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788587707.362440:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486638b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587707.362452:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043860352:0@lo:503: 00000100:00100000:0.0:1788587707.362604:0:7950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7950:1875470043860480:0@lo:502: 00000100:00100000:0.0:1788587707.362636:0:7950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.362655:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043860480 00000100:00100000:0.0:1788587707.362658:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043860480 00000100:00100000:0.0:1788587707.362674:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788587707.362679:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:7950:x1875470043860480:12345-0@lo:502: 00000100:00100000:0.0:1788587707.362808:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:7950:x1875470043860480:12345-0@lo:502: Request processed in 127us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587707.362814:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788587707.362866:0:7950:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486638480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587707.362879:0:7950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7950:1875470043860480:0@lo:502: 00000020:01000000:0.0:1788587707.362897:0:7950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587707.362904:0:7950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587707.362906:0:7950:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788587707.362911:0:7950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788587707.362913:0:7950:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788587707.362926:0:7950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7950:1875470043860608:0@lo:502: 00000100:00100000:0.0:1788587707.363025:0:7950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.363043:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043860608 00000100:00100000:0.0:1788587707.363046:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043860608 00000100:00100000:0.0:1788587707.363061:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788587707.363066:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:7950:x1875470043860608:12345-0@lo:502: 00000100:00100000:0.0:1788587707.363162:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:7950:x1875470043860608:12345-0@lo:502: Request processed in 94us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587707.363168:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788587707.363193:0:7950:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49fadc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587707.363205:0:7950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7950:1875470043860608:0@lo:502: 00000020:01000000:0.0:1788587707.363222:0:7950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587707.363227:0:7950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587707.363228:0:7950:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788587707.363231:0:7950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1788587707.363282:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788587707.363296:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788587707.363302:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca81e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.363311:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca81e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587707.363330:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788587707.363332:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88f488106000 from 30 10000000:01000000:0.0:1788587707.363335:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788587707.363354:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.363362:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.363371:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587707.363382:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043860736:0@lo:101: 00000100:00100000:0.0:1788587707.363405:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.363416:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49fadc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587707.363427:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043860736 00000100:00100000:0.0:1788587707.363431:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043860736 00000100:00100000:0.0:1788587707.363446:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788587707.363452:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043860736:12345-0@lo:101: 00010000:00010000:0.0:1788587707.363459:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587707.363469:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f480031200/0xa13e120d54ca81f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca81ec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.363486:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f480031200/0xa13e120d54ca81f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca81ec expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.363495:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f480031200/0xa13e120d54ca81f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca81ec expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.363513:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031200, rc 0) 00000100:00100000:0.0:1788587707.363540:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043860736:12345-0@lo:101: Request processed in 88us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587707.363545:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788587707.363572:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043860736:0@lo:101: 00010000:00010000:0.0:1788587707.363583:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca81f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.363592:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca81f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587707.363625:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043860864:0@lo:501: 00000100:00100000:0.0:1788587707.363647:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.363659:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49fadc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587707.363670:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043860864 00000100:00100000:0.0:1788587707.363673:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043860864 00000100:00100000:0.0:1788587707.363687:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788587707.363692:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043860864:12345-0@lo:501: 00000100:00100000:0.0:1788587707.363869:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043860864:12345-0@lo:501: Request processed in 175us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587707.363876:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788587707.363902:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043860864:0@lo:501: 00000100:00100000:0.0:1788587707.363921:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043860992:0@lo:503: 00000100:00100000:0.0:1788587707.364135:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.364156:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49fadc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587707.364174:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043860992 00000100:00100000:0.0:1788587707.364178:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043860992 00000100:00100000:0.0:1788587707.364200:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788587707.364206:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043860992:12345-0@lo:503: 00000100:00100000:0.0:1788587707.364331:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043860992:12345-0@lo:503: Request processed in 125us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587707.364337:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788587707.364373:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043860992:0@lo:503: 00000100:00100000:1.0:1788587707.365349:0:7951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7951:1875470043861120:0@lo:502: 00000100:00100000:1.0:1788587707.365391:0:7951:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587707.365424:0:7951:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf713240 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.365473:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043861120 00000100:00100000:2.0:1788587707.365478:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043861120 00000100:00100000:2.0:1788587707.365511:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788587707.365519:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:7951:x1875470043861120:12345-0@lo:502: 00000100:00100000:2.0:1788587707.365686:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:7951:x1875470043861120:12345-0@lo:502: Request processed in 167us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.365694:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788587707.365732:0:7951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7951:1875470043861120:0@lo:502: 00000100:00100000:2.0:1788587707.365771:0:7951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7951:1875470043861248:0@lo:502: 00000100:00100000:2.0:1788587707.365800:0:7951:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587707.365817:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043861248 00000100:00100000:2.0:1788587707.365821:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043861248 00000100:00100000:2.0:1788587707.365866:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788587707.365872:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:7951:x1875470043861248:12345-0@lo:502: 00000100:00100000:2.0:1788587707.365998:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:7951:x1875470043861248:12345-0@lo:502: Request processed in 126us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.366005:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788587707.366035:0:7951:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7bb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.366047:0:7951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7951:1875470043861248:0@lo:502: 00000040:00080000:2.0:1788587707.366066:0:7951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788587707.366113:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788587707.366127:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788587707.366135:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca81f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.366145:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca81f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587707.366153:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788587707.366156:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88f488106000 from 5 10000000:01000000:2.0:1788587707.366159:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788587707.366180:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.366188:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.366197:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587707.366209:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043861376:0@lo:101: 00000100:00100000:2.0:1788587707.366242:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587707.366268:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7bb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.366278:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043861376 00000100:00100000:2.0:1788587707.366281:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043861376 00000100:00100000:2.0:1788587707.366301:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788587707.366307:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043861376:12345-0@lo:101: 00010000:00010000:2.0:1788587707.366316:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587707.366326:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f481538400/0xa13e120d54ca8201 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca81fa expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.366345:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f481538400/0xa13e120d54ca8201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca81fa expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.366354:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f481538400/0xa13e120d54ca8201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca81fa expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.366362:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481538400, rc 0) 00000100:00100000:2.0:1788587707.366388:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043861376:12345-0@lo:101: Request processed in 81us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.366393:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788587707.366419:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043861376:0@lo:101: 00010000:00010000:2.0:1788587707.366430:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.366439:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587707.366477:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043861504:0@lo:256: 00000100:00100000:2.0:1788587707.366510:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587707.366523:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7bb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.366534:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043861504 00000100:00100000:2.0:1788587707.366537:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043861504 00000100:00100000:2.0:1788587707.366553:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788587707.366558:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043861504:12345-0@lo:256: 20000000:01000000:2.0:1788587707.366568:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788587707.366582:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788587707.366586:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788587707.366649:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043861504:12345-0@lo:256: Request processed in 90us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.366656:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788587707.366682:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043861504:0@lo:256: 10000000:01000000:2.0:1788587707.366716:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788587707.366721:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.366729:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587707.366737:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788587707.366738:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788587707.366741:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788587707.366754:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.366762:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.366779:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587707.366790:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043861632:0@lo:101: 00000100:00100000:2.0:1788587707.366812:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587707.366822:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7bb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.366833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043861632 00000100:00100000:2.0:1788587707.366836:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043861632 00000100:00100000:2.0:1788587707.366878:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788587707.366884:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043861632:12345-0@lo:101: 00010000:00010000:2.0:1788587707.366890:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587707.366898:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f481538a00/0xa13e120d54ca820f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8208 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.366912:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f481538a00/0xa13e120d54ca820f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8208 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.366920:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f481538a00/0xa13e120d54ca820f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8208 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.366926:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481538a00, rc 0) 00000100:00100000:2.0:1788587707.366953:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043861632:12345-0@lo:101: Request processed in 69us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.366958:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788587707.366985:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043861632:0@lo:101: 00010000:00010000:2.0:1788587707.366996:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca820f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.367015:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca820f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587707.367052:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043861760:0@lo:501: 00000100:00100000:2.0:1788587707.367074:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587707.367092:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4867699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.367103:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043861760 00000100:00100000:2.0:1788587707.367106:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043861760 00000100:00100000:2.0:1788587707.367120:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788587707.367125:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043861760:12345-0@lo:501: 00000100:00100000:2.0:1788587707.367348:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043861760:12345-0@lo:501: Request processed in 222us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.367355:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788587707.367601:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043861760:0@lo:501: 00000100:00100000:0.0:1788587707.367630:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043861888:0@lo:503: 00000100:00100000:0.0:1788587707.367665:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.367685:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49fadc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.367727:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043861888 00000100:00100000:2.0:1788587707.367732:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043861888 00000100:00100000:2.0:1788587707.367796:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788587707.367804:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043861888:12345-0@lo:503: 00000100:00100000:2.0:1788587707.368154:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043861888:12345-0@lo:503: Request processed in 351us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.368161:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788587707.368235:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1942a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043861888:0@lo:503: 00000100:00100000:1.0:1788587707.371157:0:7952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7952:1875470043862016:0@lo:502: 00000100:00100000:1.0:1788587707.371237:0:7952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587707.371284:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043862016 00000100:00100000:1.0:1788587707.371291:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043862016 00000100:00100000:1.0:1788587707.371333:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788587707.371341:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:7952:x1875470043862016:12345-0@lo:502: 00000100:00100000:1.0:1788587707.371617:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:7952:x1875470043862016:12345-0@lo:502: Request processed in 276us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587707.371626:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788587707.371671:0:7952:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7139c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587707.371691:0:7952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7952:1875470043862016:0@lo:502: 00000020:01000000:1.0:1788587707.371722:0:7952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788587707.371729:0:7952:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788587707.371735:0:7952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587707.371737:0:7952:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788587707.371742:0:7952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788587707.371745:0:7952:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.133@tcp to nid 0x20000c0a8ce85 (192.168.206.133@tcp) 00000020:01000000:1.0:1788587707.371766:0:7952:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788587707.371769:0:7952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587707.371784:0:7952:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff88f48702cd40) 00000020:00000080:1.0:1788587707.371804:0:7952:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788587707.371809:0:7952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788587707.371921:0:7952:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788587707.371927:0:7952:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788587707.372003:0:7952:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13e120d54ca821d 00010000:00080000:1.0:1788587707.372031:0:7952:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88f4c1910000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.133@tcp at head 00010000:00010000:1.0:1788587707.372246:0:7952:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788587707.372552:0:7952:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788587707.372562:0:7952:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788587707.374115:0:7952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587707.374369:0:7952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587707.374415:0:7952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788587707.374468:0:7952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788587707.375623:0:7953:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587707.375628:0:7953:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788587707.376488:0:7952:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587707.376499:0:7952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788587707.376529:0:7952:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788587707.376550:0:7952:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13e120d54ca8224 00000100:00080000:2.0:1788587707.376560:0:7952:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788587707.376566:0:7952:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88f4c1910000 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:2.0:1788587707.376603:0:7952:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f4baa53480 x1875470043862144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587707.376635:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043862144:0@lo:8: 00000100:00100000:2.0:1788587707.376694:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788587707.376749:0:7952:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788587707.376810:0:7952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587707.376814:0:7952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587707.376815:0:7952:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788587707.376818:0:7952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587707.376822:0:7952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587707.376824:0:7952:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788587707.376827:0:7952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788587707.376829:0:7952:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788587707.376894:0:7952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7952:1875470043862272:0@lo:502: 00000100:00100000:1.0:1788587707.377028:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043862144 00000100:00100000:1.0:1788587707.377035:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043862144 00000100:00100000:1.0:1788587707.377069:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587707.377076:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1875470043862144:12345-0@lo:8: 00010000:00080000:1.0:1788587707.377098:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:1.0:1788587707.377118:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13e120d54ca822b 00002000:00100000:1.0:1788587707.377135:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff88f381d11800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788587707.377139:0:6694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788587707.377143:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788587707.377243:0:6694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788587707.377393:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788587707.377413:0:6694:0:(import.c:65:import_set_state_nolock()) ffff88f381d12000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587707.377466:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875470043862144:12345-0@lo:8: Request processed in 390us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587707.377474:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587707.377525:0:7952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788587707.377568:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4baa53480 x1875470043862144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587707.377579:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587707.377586:0:3301:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788587707.377593:0:3301:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788587707.377597:0:3301:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788587707.377599:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4c1910000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788587707.377606:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788587707.377610:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043862144:0@lo:8: 00000100:00100000:2.0:1788587707.377686:0:7952:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4867699c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587707.377738:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043862272 00000100:00100000:1.0:1788587707.377743:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043862272 00000100:00100000:1.0:1788587707.377776:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788587707.377783:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:7952:x1875470043862272:12345-0@lo:502: 00000100:00100000:1.0:1788587707.378004:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:7952:x1875470043862272:12345-0@lo:502: Request processed in 221us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587707.378012:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000004:00080000:1.0:1788587707.378045:0:7953:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788587707.378117:0:7953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 154633273550ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788587707.378378:0:7952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:7952:1875470043862272:0@lo:502: 00000020:01000000:2.0:1788587707.378402:0:7952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587707.378412:0:7952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587707.378414:0:7952:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788587707.378418:0:7952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788587707.378547:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788587707.378564:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788587707.378573:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca820f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.378583:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca820f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587707.378592:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788587707.378595:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88f48709cd40 from 1 10000000:01000000:0.0:1788587707.378597:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788587707.378621:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.378629:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587707.378649:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587707.378664:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043862400:0@lo:101: 00000100:00100000:0.0:1788587707.378698:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.378760:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49fadc600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.387045:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043862400 00000100:00100000:2.0:1788587707.387057:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043862400 00000100:00100000:2.0:1788587707.387132:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788587707.387142:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043862400:12345-0@lo:101: 00010000:00010000:2.0:1788587707.387157:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587707.387174:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f481538e00/0xa13e120d54ca8239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8232 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.387198:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f481538e00/0xa13e120d54ca8239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8232 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.387209:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f481538e00/0xa13e120d54ca8239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8232 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.387218:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481538e00, rc 0) 00000100:00100000:2.0:1788587707.387296:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043862400:12345-0@lo:101: Request processed in 156us (8597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.387302:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788587707.387343:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043862400:0@lo:101: 00010000:00010000:2.0:1788587707.387360:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8239 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.387370:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca8239 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587707.387433:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043862528:0@lo:501: 00000100:00100000:2.0:1788587707.387476:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587707.387503:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4856eacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.387515:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043862528 00000100:00100000:2.0:1788587707.387518:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043862528 00000100:00100000:2.0:1788587707.387536:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788587707.387541:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043862528:12345-0@lo:501: 00000100:00100000:2.0:1788587707.387726:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043862528:12345-0@lo:501: Request processed in 184us (249us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788587707.387734:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788587707.387761:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043862528:0@lo:501: 10000000:01000000:2.0:1788587707.387783:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788587707.387790:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8239 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587707.387798:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8239 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788587707.426290:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788587707.427052:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587707.427071:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043862656:0@lo:13: 00000100:00100000:3.0:1788587707.427136:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587707.427192:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043862656 00000100:00100000:3.0:1788587707.427273:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043862656 00000100:00100000:3.0:1788587707.427333:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587707.427342:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875470043862656:12345-0@lo:13: 00002000:00000024:3.0:1788587707.427373:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788587707.427418:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875470043862656:12345-0@lo:13: Request processed in 77us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587707.427426:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788587707.427463:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b4807800 x1875470043862656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587707.427482:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043862656:0@lo:13: 00000004:00080000:3.0:1788587707.427498:0:7954:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788587707.427516:0:7954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7954:1875470043862784:0@lo:7: 00000100:00100000:3.0:1788587707.427540:0:7954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587707.427566:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043862784 00000100:00100000:3.0:1788587707.427569:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043862784 00000100:00100000:3.0:1788587707.427592:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587707.427599:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7954:x1875470043862784:12345-0@lo:7: 00000100:00080000:1.0:1788587707.429315:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587707.431071:0:7954:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4908e1840 going to sleep for 11 seconds 00002000:00080000:2.0:1788587707.440001:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788587707.440008:0:6693:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788587707.440089:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7954:x1875470043862784:12345-0@lo:7: Request processed in 12485us (12543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.440100:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788587707.440206:0:7954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b4807800 x1875470043862784/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788587723 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587707.440223:0:7954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7954:1875470043862784:0@lo:7: 00000004:00080000:0.0:1788587707.440237:0:7954:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788587707.440282:0:7954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1940e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7954:1875470043862912:0@lo:5: 00000100:00100000:0.0:1788587707.440316:0:7954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.440371:0:7954:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49fadca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587707.440385:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043862912 00000100:00100000:2.0:1788587707.440392:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043862912 00000100:00100000:2.0:1788587707.440433:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587707.440442:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7954:x1875470043862912:12345-0@lo:5: 00002000:00080000:2.0:1788587707.440464:0:6695:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788587707.440468:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788587707.440671:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7954:x1875470043862912:12345-0@lo:5: Request processed in 229us (353us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788587707.440677:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788587707.441314:0:7954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4c1940e00 x1875470043862912/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587723 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587707.441328:0:7954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1940e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7954:1875470043862912:0@lo:5: 00000004:00080000:0.0:1788587707.441338:0:7954:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788587707.441364:0:7954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7954:1875470043863040:0@lo:700: 00000100:00100000:0.0:1788587707.441395:0:7954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587707.441423:0:7954:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49fadca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587707.441587:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043863040 00000100:00100000:3.0:1788587707.441592:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043863040 00000100:00100000:3.0:1788587707.441633:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587707.441641:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7954:x1875470043863040:12345-0@lo:700: 00000100:00100000:3.0:1788587707.441678:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4806a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6701:1875470043863168:0@lo:700: 00000100:00100000:3.0:1788587707.441709:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587707.441733:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4908e1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587707.441760:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043863168 00000100:00100000:0.0:1788587707.441766:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043863168 00000100:00100000:0.0:1788587707.441806:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587707.441814:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6701:x1875470043863168:12345-0@lo:700: 40000000:02000000:0.0:1788587707.483767:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788587707.493049:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6701:x1875470043863168:12345-0@lo:700: Request processed in 51228us (51331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587707.493063:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788587707.495420:0:6701:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b4806a00 x1875470043863168/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788587723 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587707.495437:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4806a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6701:1875470043863168:0@lo:700: 40000000:02000000:3.0:1788587707.495450:0:6701:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1788587707.609665:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788587707.609686:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1788587707.610312:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7954:x1875470043863040:12345-0@lo:700: Request processed in 168667us (168912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587707.610329:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788587707.610447:0:7954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4c1943b80 x1875470043863040/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788587723 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587707.610458:0:7954:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788587707.610473:0:7954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7954:1875470043863040:0@lo:700: 00000004:02000040:1.0:1788587707.667155:0:7954:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788587707.678094:0:7954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ad880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7954:1875470043863296:0@lo:5: 00000100:00100000:2.0:1788587707.678154:0:7954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587707.678212:0:7954:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7baf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587707.678338:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043863296 00000100:00100000:0.0:1788587707.678345:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043863296 00000100:00100000:0.0:1788587707.678397:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587707.678406:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7954:x1875470043863296:12345-0@lo:5: 00002000:00080000:2.0:1788587707.687665:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788587707.687684:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788587707.695056:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7954:x1875470043863296:12345-0@lo:5: Request processed in 16644us (16895us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788587707.695069:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788587707.701899:0:7954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b53ad880 x1875470043863296/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587723 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587707.701920:0:7954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ad880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7954:1875470043863296:0@lo:5: 00000004:00080000:0.0:1788587707.701949:0:7954:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:3.0:1788587707.790140:0:7998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg633-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788587707.849545:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587708.872153:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587709.896180:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587710.921022:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587711.434797:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587711.434832:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043863424:0@lo:13: 00000100:00100000:0.0:1788587711.434947:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587711.435173:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043863424 00000100:00100000:3.0:1788587711.435184:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043863424 00000100:00100000:3.0:1788587711.435275:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587711.435288:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043863424:12345-0@lo:13: 00002000:00000024:3.0:1788587711.435334:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587711.435391:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043863424:12345-0@lo:13: Request processed in 106us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587711.435399:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788587711.435449:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4c1943b80 x1875470043863424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587711.435471:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043863424:0@lo:13: 00000100:00080000:0.0:1788587711.436141:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788587711.951385:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587712.456315:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587712.456354:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043863552:0@lo:13: 00000100:00100000:3.0:1788587712.456472:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587712.456535:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043863552 00000100:00100000:2.0:1788587712.456545:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043863552 00000100:00100000:2.0:1788587712.456622:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587712.456634:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875470043863552:12345-0@lo:13: 00002000:00000024:2.0:1788587712.456678:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788587712.456687:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587712.456738:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875470043863552:12345-0@lo:13: Request processed in 106us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587712.456745:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587712.457182:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043863808:0@lo:400: 00000100:00100000:1.0:1788587712.457222:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587712.457260:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587712.457265:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043863936:0@lo:400: 00000100:00100000:1.0:1788587712.457298:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587712.457328:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043863808 00000100:00100000:1.0:1788587712.457333:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043863808 00000100:00100000:1.0:1788587712.457365:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043863936 00000100:00100000:1.0:1788587712.457368:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043863936 00000100:00100000:1.0:1788587712.457393:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788587712.457400:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043863808:12345-0@lo:400: 00000100:00100000:1.0:1788587712.457439:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043863808:12345-0@lo:400: Request processed in 40us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587712.457446:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587712.457447:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043863680:0@lo:400: 00000100:00100000:1.0:1788587712.457460:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788587712.457465:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043863936:12345-0@lo:400: 00000100:00100000:3.0:1788587712.457480:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587712.457490:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043863936:12345-0@lo:400: Request processed in 25us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587712.457495:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788587712.457502:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043864192:0@lo:400: 00000100:00080000:1.0:1788587712.457519:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587712.457523:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788587712.457546:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b4806a00 x1875470043863552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788587712.457546:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b53ac000 x1875470043863936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587712.457561:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043863936:0@lo:400: 00000100:00100000:3.0:1788587712.457566:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043863552:0@lo:13: 00010000:00080000:1.0:1788587712.457570:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b53ae300 x1875470043863808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587712.457577:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043863808:0@lo:400: 00000100:00100000:3.0:1788587712.457587:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587712.457591:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043864192 00000100:00100000:3.0:1788587712.457593:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043864064:0@lo:400: 00000100:00100000:1.0:1788587712.457594:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043864192 00000100:00100000:3.0:1788587712.457617:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587712.457617:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788587712.457623:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043864192:12345-0@lo:400: 00000100:00100000:3.0:1788587712.457643:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043864064 00000100:00100000:3.0:1788587712.457647:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043864064 00000100:00100000:1.0:1788587712.457661:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043864192:12345-0@lo:400: Request processed in 39us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587712.457667:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788587712.457681:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587712.457685:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587712.457692:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043864064:12345-0@lo:400: 00010000:00080000:1.0:1788587712.457696:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b53af480 x1875470043864192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587712.457704:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043864192:0@lo:400: 00000100:00100000:2.0:1788587712.457772:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043863680 00000100:00100000:2.0:1788587712.457776:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043863680 00000100:00100000:2.0:1788587712.457807:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788587712.457814:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043863680:12345-0@lo:400: 00000100:00100000:3.0:1788587712.460059:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043864064:12345-0@lo:400: Request processed in 2356us (2429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587712.460075:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587712.460211:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043863680:12345-0@lo:400: Request processed in 2394us (2726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587712.460244:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1788587712.469976:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b53af800 x1875470043864064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587712.469999:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043864064:0@lo:400: 00000100:00100000:0.0:1788587712.470085:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043863680:0@lo:400: 00000001:00080000:2.0:1788587712.870291:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788587712.968268:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587713.335989:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587713.336065:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026014848 00000100:00100000:2.0:1788587713.336079:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026014848 00000100:00100000:2.0:1788587713.336139:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 112 00000100:00100000:2.0:1788587713.336151:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2343:x1875470026014848:12345-192.168.206.33@tcp:250: 00010000:00080000:2.0:1788587713.336190:0:5836:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 14b4c4f4-b2bd-4677-ba5e-e54a3823d28b@192.168.206.33@tcp t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:2.0:1788587713.336247:0:5836:0:(genops.c:1385:class_connect()) connect: client 14b4c4f4-b2bd-4677-ba5e-e54a3823d28b, cookie 0xa13e120d54ca8240 00000100:00080000:2.0:1788587713.337512:0:5836:0:(import.c:65:import_set_state_nolock()) ffff88f4b50ff000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587713.337632:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+5:2343:x1875470026014848:12345-192.168.206.33@tcp:250: Request processed in 1480us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587713.337644:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 112 00000100:00100000:1.0:1788587713.349647:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587713.356536:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026014976 00000100:00100000:3.0:1788587713.356556:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026014976 00000100:00100000:3.0:1788587713.357031:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 113 00000100:00100000:3.0:1788587713.357046:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+5:5573:x1875470026014976:12345-192.168.206.33@tcp:101: 00010000:00010000:3.0:1788587713.357068:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587713.357091:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca8247 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db0ff7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587713.357154:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca8247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ff7 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587713.357167:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca8247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ff7 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587713.357264:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed5800, rc 0) 00000100:00100000:3.0:1788587713.357430:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+6:5573:x1875470026014976:12345-192.168.206.33@tcp:101: Request processed in 387us (7794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587713.357438:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 113 00000100:00100000:1.0:1788587713.366104:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587713.366304:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026015104 00000100:00100000:3.0:1788587713.366317:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026015104 00000100:00100000:3.0:1788587713.366386:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 114 00000100:00100000:3.0:1788587713.366398:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+6:5573:x1875470026015104:12345-192.168.206.33@tcp:501: 00000100:00100000:3.0:1788587713.366731:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+6:5573:x1875470026015104:12345-192.168.206.33@tcp:501: Request processed in 322us (627us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587713.366740:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 114 00000100:00100000:0.0:1788587713.377719:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587713.377904:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026015232 00000100:00100000:3.0:1788587713.377918:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026015232 00000100:00100000:3.0:1788587713.377989:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 115 00000100:00100000:3.0:1788587713.378001:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+6:5573:x1875470026015232:12345-192.168.206.33@tcp:101: 00010000:00010000:3.0:1788587713.378024:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587713.378046:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4baed4400/0xa13e120d54ca824e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db0ffe expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587713.378092:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed4400/0xa13e120d54ca824e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ffe expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587713.378120:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4baed4400/0xa13e120d54ca824e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ffe expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587713.378131:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed4400, rc 0) 00000100:00100000:3.0:1788587713.378205:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+7:5573:x1875470026015232:12345-192.168.206.33@tcp:101: Request processed in 207us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587713.378212:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 115 00000100:00100000:1.0:1788587713.381914:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587713.382683:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026015360 00000100:00100000:3.0:1788587713.382700:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026015360 00000100:00100000:3.0:1788587713.382771:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 116 00000100:00100000:3.0:1788587713.382783:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+7:5573:x1875470026015360:12345-192.168.206.33@tcp:501: 00000100:00100000:1.0:1788587713.383719:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+8:5573:x1875470026015360:12345-192.168.206.33@tcp:501: Request processed in 933us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587713.383732:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 116 00000100:00100000:3.0:1788587713.390468:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587713.390564:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026015488 00000100:00100000:2.0:1788587713.390576:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026015488 00000100:00100000:2.0:1788587713.390712:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 117 00000100:00100000:2.0:1788587713.390922:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+8:5573:x1875470026015488:12345-192.168.206.33@tcp:503: 00000100:00100000:2.0:1788587713.391909:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+8:5573:x1875470026015488:12345-192.168.206.33@tcp:503: Request processed in 1175us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587713.391923:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 117 00000100:00100000:3.0:1788587713.397074:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587713.397373:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026015616 00000100:00100000:1.0:1788587713.397387:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026015616 00000100:00100000:1.0:1788587713.397451:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 118 00000100:00100000:1.0:1788587713.397463:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+8:5592:x1875470026015616:12345-192.168.206.33@tcp:502: 00000100:00100000:1.0:1788587713.397919:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+8:5592:x1875470026015616:12345-192.168.206.33@tcp:502: Request processed in 455us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587713.397929:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 118 00000100:00100000:0.0:1788587713.431330:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587713.431521:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026015744 00000100:00100000:3.0:1788587713.431546:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026015744 00000100:00100000:3.0:1788587713.431616:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 119 00000100:00100000:3.0:1788587713.431629:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+8:5592:x1875470026015744:12345-192.168.206.33@tcp:502: 00000100:00100000:3.0:1788587713.431997:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+8:5592:x1875470026015744:12345-192.168.206.33@tcp:502: Request processed in 370us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587713.432007:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 119 00000100:00100000:1.0:1788587713.451391:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587713.456407:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026015872 00000100:00100000:3.0:1788587713.456427:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026015872 00000100:00100000:3.0:1788587713.457120:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 120 00000100:00100000:3.0:1788587713.457136:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+8:5573:x1875470026015872:12345-192.168.206.33@tcp:101: 00010000:00010000:3.0:1788587713.457158:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587713.457199:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4baed4200/0xa13e120d54ca8255 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1028 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587713.457248:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed4200/0xa13e120d54ca8255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1028 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587713.457261:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4baed4200/0xa13e120d54ca8255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1028 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587713.457273:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed4200, rc 0) 00000100:00100000:3.0:1788587713.457358:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:5573:x1875470026015872:12345-192.168.206.33@tcp:101: Request processed in 226us (5981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587713.457371:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 120 00000100:00100000:3.0:1788587713.463333:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587713.463443:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026016000 00000100:00100000:2.0:1788587713.463456:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026016000 00000100:00100000:2.0:1788587713.464040:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 121 00000100:00100000:2.0:1788587713.464057:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:5573:x1875470026016000:12345-192.168.206.33@tcp:256: 20000000:01000000:2.0:1788587713.464092:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788587713.464128:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788587713.464132:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788587713.464136:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788587713.464139:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788587713.477507:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:5573:x1875470026016000:12345-192.168.206.33@tcp:256: Request processed in 13439us (14173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587713.477525:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 121 00000100:00100000:3.0:1788587713.483604:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587713.484154:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026016128 00000100:00100000:0.0:1788587713.484169:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026016128 00000100:00100000:0.0:1788587713.484248:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 122 00000100:00100000:0.0:1788587713.484261:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:5573:x1875470026016128:12345-192.168.206.33@tcp:101: 00010000:00010000:0.0:1788587713.484282:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587713.484306:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca825c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db102f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587713.484352:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca825c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db102f expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587713.484366:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca825c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db102f expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587713.484377:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b600, rc 0) 00000100:00100000:0.0:1788587713.484444:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5573:x1875470026016128:12345-192.168.206.33@tcp:101: Request processed in 186us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587713.484452:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 122 00000100:00100000:3.0:1788587713.489507:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587713.489586:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026016256 00000100:00100000:3.0:1788587713.489598:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026016256 00000100:00100000:3.0:1788587713.489665:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 123 00000100:00100000:3.0:1788587713.489678:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5573:x1875470026016256:12345-192.168.206.33@tcp:501: 00000100:00100000:3.0:1788587713.490030:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5573:x1875470026016256:12345-192.168.206.33@tcp:501: Request processed in 353us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587713.490040:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 123 00000100:00100000:3.0:1788587713.493391:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587713.493519:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026016384 00000100:00100000:0.0:1788587713.493532:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026016384 00000100:00100000:0.0:1788587713.493940:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 124 00000100:00100000:0.0:1788587713.493953:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5573:x1875470026016384:12345-192.168.206.33@tcp:503: 00000100:00100000:0.0:1788587713.494720:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5573:x1875470026016384:12345-192.168.206.33@tcp:503: Request processed in 764us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587713.494745:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 124 00000100:00100000:1.0:1788587713.498368:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587713.498467:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026016512 00000100:00100000:3.0:1788587713.498490:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026016512 00000100:00100000:3.0:1788587713.498588:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 125 00000100:00100000:3.0:1788587713.498599:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5597:x1875470026016512:12345-192.168.206.33@tcp:502: 00000100:00100000:3.0:1788587713.498947:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5597:x1875470026016512:12345-192.168.206.33@tcp:502: Request processed in 347us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587713.498956:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 125 00000100:00100000:3.0:1788587713.503408:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587713.503490:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026016640 00000100:00100000:0.0:1788587713.503502:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026016640 00000100:00100000:0.0:1788587713.503568:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 126 00000100:00100000:0.0:1788587713.503580:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5597:x1875470026016640:12345-192.168.206.33@tcp:502: 00000100:00100000:0.0:1788587713.503974:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5597:x1875470026016640:12345-192.168.206.33@tcp:502: Request processed in 395us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587713.503984:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 126 00000100:00100000:2.0:1788587713.512820:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587713.513305:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026016768 00000100:00100000:0.0:1788587713.513319:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026016768 00000100:00100000:0.0:1788587713.513383:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 4 00000100:00100000:0.0:1788587713.513405:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2343:x1875470026016768:12345-192.168.206.33@tcp:38: 00010000:00080000:0.0:1788587713.513442:0:7276:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:0.0:1788587713.513514:0:7276:0:(genops.c:1385:class_connect()) connect: client 5bcb85a0-1673-40ab-a41b-fd8baee9796e, cookie 0xa13e120d54ca8263 00000004:00100000:0.0:1788587713.513553:0:7276:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788587713.513561:0:7276:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788587713.575671:0:7276:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb08000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587713.575934:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2343:x1875470026016768:12345-192.168.206.33@tcp:38: Request processed in 62539us (63126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587713.575946:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 4 00010000:00010000:3.0:1788587713.996458:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587714.590297:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587714.590406:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026016896 00000100:00100000:1.0:1788587714.590420:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026016896 00000100:00100000:1.0:1788587714.590530:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:1.0:1788587714.590543:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:0:x1875470026016896:12345-192.168.206.33@tcp:41: 00000004:00000024:1.0:1788587714.590619:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:2.0:1788587714.592345:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587714.592674:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587714.592838:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026017024 00000100:00100000:2.0:1788587714.592872:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026017024 00000100:00100000:2.0:1788587714.592944:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:2.0:1788587714.592966:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:5573:x1875470026017024:12345-192.168.206.33@tcp:41: 00000004:00000024:2.0:1788587714.593005:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788587714.595190:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:0:x1875470026016896:12345-192.168.206.33@tcp:41: Request processed in 4640us (4899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587714.595226:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:2.0:1788587714.596353:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:5573:x1875470026017024:12345-192.168.206.33@tcp:41: Request processed in 3378us (3675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587714.596366:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:3.0:1788587714.607601:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587714.607876:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026017152 00000100:00100000:1.0:1788587714.607885:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026017152 00000100:00100000:1.0:1788587714.607983:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:1.0:1788587714.607994:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:5573:x1875470026017152:12345-192.168.206.33@tcp:40: 00000100:00100000:1.0:1788587714.608089:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:5573:x1875470026017152:12345-192.168.206.33@tcp:40: Request processed in 97us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587714.608096:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:0.0:1788587714.611414:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587714.611453:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587714.611585:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026017536 00000100:00100000:2.0:1788587714.611593:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026017536 00000100:00100000:0.0:1788587714.611786:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587714.611917:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00100000:2.0:1788587714.611927:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:5573:x1875470026017536:12345-192.168.206.33@tcp:33: 00000100:00100000:3.0:1788587714.612099:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026017280 00000100:00100000:3.0:1788587714.612104:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026017280 00000100:00100000:3.0:1788587714.612125:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026017408 00000100:00100000:3.0:1788587714.612128:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026017408 00000100:00100000:3.0:1788587714.612139:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 8 00000100:00100000:3.0:1788587714.612145:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1875470026017280:12345-192.168.206.33@tcp:8: 00010000:00080000:3.0:1788587714.612166:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:3.0:1788587714.612192:0:6693:0:(genops.c:1385:class_connect()) connect: client 5bcb85a0-1673-40ab-a41b-fd8baee9796e, cookie 0xa13e120d54ca826a 00000100:00100000:2.0:1788587714.612435:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587714.612467:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026017664 00000100:00100000:2.0:1788587714.612485:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026017664 00000100:00100000:2.0:1788587714.612511:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 127 00000100:00100000:2.0:1788587714.612518:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2344:x1875470026017664:12345-192.168.206.33@tcp:400: 00000100:00100000:2.0:1788587714.612570:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2344:x1875470026017664:12345-192.168.206.33@tcp:400: Request processed in 52us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587714.612577:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 127 00002000:00100000:3.0:1788587714.612931:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5bcb85a0-1673-40ab-a41b-fd8baee9796e/ffff88f4bfb08800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788587714.612954:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788587714.616862:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788587714.616903:0:6693:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb09000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587714.616967:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2343:x1875470026017280:12345-192.168.206.33@tcp:8: Request processed in 4821us (5512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587714.616977:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 8 00000100:00100000:3.0:1788587714.617007:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00100000:3.0:1788587714.617013:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1875470026017408:12345-192.168.206.33@tcp:8: 00010000:00080000:3.0:1788587714.617034:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:3.0:1788587714.617057:0:6693:0:(genops.c:1385:class_connect()) connect: client 5bcb85a0-1673-40ab-a41b-fd8baee9796e, cookie 0xa13e120d54ca8271 00002000:00100000:3.0:1788587714.617068:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5bcb85a0-1673-40ab-a41b-fd8baee9796e/ffff88f4bfb0e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788587714.617087:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788587714.617460:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788587714.617535:0:6693:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb44800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587714.617558:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2343:x1875470026017408:12345-192.168.206.33@tcp:8: Request processed in 543us (5772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587714.617564:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 9 00000004:00080000:2.0:1788587714.638880:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26891us 00000004:00200000:2.0:1788587714.691512:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788587714.691615:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:5573:x1875470026017536:12345-192.168.206.33@tcp:33: Request processed in 79685us (80206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587714.691624:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00100000:2.0:1788587714.952750:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587714.953127:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026017792 00000100:00100000:1.0:1788587714.953138:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026017792 00000100:00100000:1.0:1788587714.953198:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 8 00000100:00100000:1.0:1788587714.953209:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:5614:x1875470026017792:12345-192.168.206.33@tcp:101: 00010000:00010000:1.0:1788587714.953235:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587714.953313:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668800/0xa13e120d54ca8278 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1059 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587714.953375:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca827f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587714.953388:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca827f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587714.953405:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca827f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587714.953452:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587714.953455:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587714.953469:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca827f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587714.953491:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668800/0xa13e120d54ca8278 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1059 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587714.953507:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca827f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1059 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587714.953517:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37100) 00010000:00010000:1.0:1788587714.953519:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587714.953522:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481668c00, rc 0) 00000100:00100000:1.0:1788587714.953579:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:5614:x1875470026017792:12345-192.168.206.33@tcp:101: Request processed in 372us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587714.953585:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 8 00010000:00010000:2.0:1788587715.016078:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587716.040149:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587716.552158:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043864320:0@lo:13: 00000100:00100000:1.0:1788587716.552236:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587716.552393:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043864320 00000100:00100000:2.0:1788587716.552401:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043864320 00000100:00100000:2.0:1788587716.552466:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587716.552478:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043864320:12345-0@lo:13: 00002000:00000024:2.0:1788587716.552576:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587716.552633:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043864320:12345-0@lo:13: Request processed in 159us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587716.552640:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788587716.552689:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6f9f80 x1875470043864320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587716.552696:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587716.552707:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043864320:0@lo:13: 00010000:00010000:2.0:1788587717.065187:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587717.112582:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587717.112616:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026017920 00000100:00100000:3.0:1788587717.112625:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026017920 00000100:00100000:3.0:1788587717.112685:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00100000:3.0:1788587717.112696:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:5666:x1875470026017920:12345-192.168.206.33@tcp:41: 00000004:00000024:3.0:1788587717.112741:0:7276:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788587717.112799:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:5666:x1875470026017920:12345-192.168.206.33@tcp:41: Request processed in 105us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587717.112807:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00080000:3.0:1788587717.112826:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587717.118168:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587717.120026:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026018048 00000100:00100000:3.0:1788587717.120051:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026018048 00000100:00100000:3.0:1788587717.120113:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00100000:3.0:1788587717.120124:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:5666:x1875470026018048:12345-192.168.206.33@tcp:13: 00002000:00000024:3.0:1788587717.120149:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587717.120231:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:5666:x1875470026018048:12345-192.168.206.33@tcp:13: Request processed in 100us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587717.120238:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00080000:1.0:1788587717.120727:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788587717.124636:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000100:00100000:3.0:1788587717.126715:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587717.126879:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026018176 00000100:00100000:2.0:1788587717.126895:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026018176 00000100:00100000:2.0:1788587717.126987:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:2.0:1788587717.127000:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:5666:x1875470026018176:12345-192.168.206.33@tcp:13: 00002000:00000024:2.0:1788587717.127064:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587717.127146:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:5666:x1875470026018176:12345-192.168.206.33@tcp:13: Request processed in 149us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587717.127159:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00080000:1.0:1788587717.127325:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587717.576254:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043864704:0@lo:400: 00000100:00100000:2.0:1788587717.576347:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587717.576425:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788587717.576433:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043864576:0@lo:400: 00000100:00100000:2.0:1788587717.576478:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587717.576500:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043865088:0@lo:400: 00000100:00100000:2.0:1788587717.576545:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587717.576590:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043864704 00000100:00100000:2.0:1788587717.576599:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043864704 00000100:00100000:2.0:1788587717.576665:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043864576 00000100:00100000:2.0:1788587717.576669:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043864576 00000100:00100000:2.0:1788587717.576694:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587717.576703:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043864704:12345-0@lo:400: 00000100:00100000:2.0:1788587717.576760:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043864704:12345-0@lo:400: Request processed in 57us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587717.576768:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587717.576788:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788587717.576795:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043864576:12345-0@lo:400: 00000100:00100000:2.0:1788587717.576822:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043864576:12345-0@lo:400: Request processed in 27us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587717.576827:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788587717.576887:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043865088 00000100:00100000:2.0:1788587717.576891:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043865088 00000100:00100000:2.0:1788587717.576922:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587717.576929:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043865088:12345-0@lo:400: 00000100:00100000:2.0:1788587717.576961:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043865088:12345-0@lo:400: Request processed in 32us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587717.576967:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587717.577024:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043864576:0@lo:400: 00010000:00080000:2.0:1788587717.577039:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4baa53b80 x1875470043865088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587717.577061:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788587717.577079:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043865088:0@lo:400: 00000100:00100000:2.0:1788587717.577095:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043864704:0@lo:400: 00000100:00100000:0.0:1788587717.577196:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043864832:0@lo:400: 00000100:00100000:0.0:1788587717.577253:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587717.577287:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788587717.577294:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043864448:0@lo:400: 00000100:00100000:0.0:1788587717.577327:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587717.577350:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043864960:0@lo:400: 00000100:00100000:0.0:1788587717.577371:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587717.577471:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043864960 00000100:00100000:1.0:1788587717.577476:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043864960 00000100:00100000:1.0:1788587717.577528:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587717.577539:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043864960:12345-0@lo:400: 00000100:00100000:1.0:1788587717.577604:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043864960:12345-0@lo:400: Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587717.577613:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788587717.577634:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587717.577640:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587717.577667:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043864960:0@lo:400: 00000100:00100000:1.0:1788587717.577987:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587717.578002:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043865216:0@lo:13: 00000100:00100000:1.0:1788587717.578049:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587717.578123:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043865216 00000100:00100000:0.0:1788587717.578129:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043865216 00000100:00100000:0.0:1788587717.578169:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587717.578177:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043865216:12345-0@lo:13: 00002000:00000024:0.0:1788587717.578196:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587717.578249:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043865216:12345-0@lo:13: Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587717.578256:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788587717.578329:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6f9880 x1875470043865216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587717.578346:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043865216:0@lo:13: 00000100:00100000:2.0:1788587717.579779:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043864832 00000100:00100000:2.0:1788587717.579795:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043864832 00000100:00100000:2.0:1788587717.579961:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587717.579974:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043864832:12345-0@lo:400: 00000100:00100000:2.0:1788587717.580075:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043864832:12345-0@lo:400: Request processed in 103us (2822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587717.580082:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788587717.580173:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4baa52680 x1875470043864832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587717.580189:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043864832:0@lo:400: 00000100:00100000:3.0:1788587717.583218:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043864448 00000100:00100000:3.0:1788587717.583237:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043864448 00000100:00100000:3.0:1788587717.583328:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788587717.583341:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485ca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043864448:12345-0@lo:400: 00000100:00100000:3.0:1788587717.583465:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485ca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043864448:12345-0@lo:400: Request processed in 127us (6136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587717.583472:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788587717.583642:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043864448:0@lo:400: 00010000:00010000:2.0:1788587718.090979:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788587718.624887:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5bcb85a0-1673-40ab-a41b-fd8baee9796e 00010000:00010000:3.0:1788587719.116438:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788587719.194383:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000001:02000400:3.0:1788587719.207823:0:8306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788587719.650618:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587719.650663:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587719.650705:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587719.650744:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587719.650832:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026018304 00000100:00100000:0.0:1788587719.650873:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026018304 00000100:00100000:0.0:1788587719.650919:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 129 00000100:00100000:0.0:1788587719.650930:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2346:x1875470026018304:12345-192.168.206.33@tcp:400: 00000100:00100000:3.0:1788587719.650997:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026018560 00000100:00100000:0.0:1788587719.650999:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2346:x1875470026018304:12345-192.168.206.33@tcp:400: Request processed in 70us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587719.651003:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026018560 00000100:00100000:0.0:1788587719.651011:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 129 00000100:00100000:3.0:1788587719.651044:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026018688 00000100:00100000:3.0:1788587719.651048:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026018688 00000100:00100000:3.0:1788587719.651069:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:3.0:1788587719.651077:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2346:x1875470026018560:12345-192.168.206.33@tcp:400: 00000100:00100000:3.0:1788587719.651122:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2346:x1875470026018560:12345-192.168.206.33@tcp:400: Request processed in 45us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587719.651130:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:3.0:1788587719.651146:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:3.0:1788587719.651155:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2346:x1875470026018688:12345-192.168.206.33@tcp:400: 00000100:00100000:3.0:1788587719.651205:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2346:x1875470026018688:12345-192.168.206.33@tcp:400: Request processed in 52us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587719.651211:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:1.0:1788587719.651264:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026018432 00000100:00100000:1.0:1788587719.651269:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026018432 00000100:00100000:1.0:1788587719.651310:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 21 00000100:00100000:1.0:1788587719.651318:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026018432:12345-192.168.206.33@tcp:400: 00000100:00100000:1.0:1788587719.651347:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026018432:12345-192.168.206.33@tcp:400: Request processed in 30us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587719.651353:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 21 00000100:00080000:1.0:1788587719.651369:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587719.651373:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587719.651381:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788587720.136965:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587721.160233:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587721.672235:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587721.672268:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043865344:0@lo:13: 00000100:00100000:3.0:1788587721.672356:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587721.672551:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043865344 00000100:00100000:0.0:1788587721.672562:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043865344 00000100:00100000:0.0:1788587721.672649:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587721.672660:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043865344:12345-0@lo:13: 00002000:00000024:0.0:1788587721.672721:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587721.672787:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043865344:12345-0@lo:13: Request processed in 129us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587721.672795:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788587721.672883:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6f9180 x1875470043865344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587721.672901:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587721.672909:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043865344:0@lo:13: 00010000:00010000:2.0:1788587722.184051:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788587722.375066:0:8454:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3712d790 20000000:00000080:1.0:1788587722.375090:0:8454:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88f4baa20800 uarg=0000000000000000 20000000:01000000:1.0:1788587722.375222:0:8454:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788587722.375225:0:8454:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788587722.375229:0:8454:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788587722.375235:0:8454:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788587722.375241:0:8454:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788587722.375258:0:8454:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788587722.375260:0:8454:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788587722.375801:0:8454:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788587722.375805:0:8454:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788587722.377749:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788587722.379325:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788587722.379413:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788587722.379454:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788587722.379474:0:8454:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788587722.379478:0:8454:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788587722.380830:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788587722.381818:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788587722.382356:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788587722.382430:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788587722.382456:0:8454:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788587722.382460:0:8454:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788587722.383627:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788587722.384562:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788587722.384623:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788587722.384658:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788587722.384674:0:8454:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788587722.384677:0:8454:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788587722.387718:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788587722.393590:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788587722.393697:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788587722.393742:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1788587722.393770:0:8454:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788587722.393796:0:8454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.393819:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f481669400/0xa13e120d54ca8183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca817c expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.393827:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f480030200/0xa13e120d54ca81ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca81a6 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.393872:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f480031400/0xa13e120d54ca81d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca81d0 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.393880:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f481669a00/0xa13e120d54ca81e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca81de expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.393888:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f480031200/0xa13e120d54ca81f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca81ec expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.393895:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f481538a00/0xa13e120d54ca820f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8208 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.393902:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f481538e00/0xa13e120d54ca8239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8232 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.393912:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca8247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ff7 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.393919:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4baed4400/0xa13e120d54ca824e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ffe expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.393927:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.393973:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4baed4400/0xa13e120d54ca824e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ffe expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.393991:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f4baed4400/0xa13e120d54ca824e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ffe expref: 9 pid: 5835 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.394018:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4867b6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043865472:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587722.394141:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca8247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ff7 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.394150:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca8247 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ff7 expref: 9 pid: 5835 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.394159:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4867b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043865600:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587722.394199:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f481538e00/0xa13e120d54ca8239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca8232 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.394208:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f481538e00/0xa13e120d54ca8239 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca8232 expref: 18 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.394218:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4867b5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043865728:0@lo:104: 00000100:00100000:3.0:1788587722.394258:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587722.394296:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f481538a00/0xa13e120d54ca820f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca8208 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.394305:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f481538a00/0xa13e120d54ca820f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca8208 expref: 18 pid: 5835 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.394313:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4867b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043865856:0@lo:104: 00000100:00100000:3.0:1788587722.394336:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587722.394944:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f480031200/0xa13e120d54ca81f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca81ec expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.394955:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f480031200/0xa13e120d54ca81f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca81ec expref: 18 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.394974:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4867b7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043865984:0@lo:104: 00010000:00010000:3.0:1788587722.395003:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f481669a00/0xa13e120d54ca81e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca81de expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.395011:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f481669a00/0xa13e120d54ca81e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca81de expref: 18 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.395018:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4867b7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043866112:0@lo:104: 00010000:00010000:3.0:1788587722.395036:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f480031400/0xa13e120d54ca81d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca81d0 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.395043:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f480031400/0xa13e120d54ca81d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca81d0 expref: 18 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.395051:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4806a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043866240:0@lo:104: 00010000:00010000:3.0:1788587722.395085:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f480030200/0xa13e120d54ca81ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca81a6 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.395092:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f480030200/0xa13e120d54ca81ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca81a6 expref: 18 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.395101:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c94e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043866368:0@lo:104: 00010000:00010000:3.0:1788587722.395121:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f481669400/0xa13e120d54ca8183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca817c expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.395129:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f481669400/0xa13e120d54ca8183 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca817c expref: 18 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.395427:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c94700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043866496:0@lo:104: 00000100:00100000:3.0:1788587722.395458:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4857a0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587722.397021:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043865728 00000100:00100000:2.0:1788587722.397043:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043865728 00000100:00100000:2.0:1788587722.397126:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788587722.397193:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587722.397224:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587722.397235:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587722.397245:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587722.397256:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587722.397266:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043865856 00000100:00100000:2.0:1788587722.397269:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043865856 00000100:00100000:2.0:1788587722.397284:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043865984 00000100:00100000:2.0:1788587722.397287:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043865984 00000100:00100000:2.0:1788587722.397296:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043866112 00000100:00100000:2.0:1788587722.397299:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043866112 00000100:00100000:2.0:1788587722.397306:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043866240 00000100:00100000:2.0:1788587722.397309:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043866240 00000100:00100000:2.0:1788587722.397318:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043866368 00000100:00100000:2.0:1788587722.397320:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043866368 00000100:00100000:2.0:1788587722.397331:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043866496 00000100:00100000:2.0:1788587722.397334:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043866496 00000100:00100000:2.0:1788587722.397349:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587722.397359:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:8454:x1875470043865728:12345-0@lo:104: 00010000:00010000:2.0:1788587722.397382:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8239 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.397463:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788587722.397470:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:8454:x1875470043865728:12345-0@lo:104: Request processed in 113us (3212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587722.397477:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587722.397496:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587722.397502:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+8:8454:x1875470043865856:12345-0@lo:104: 00010000:00010000:2.0:1788587722.397530:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca820f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.397575:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788587722.397580:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+8:8454:x1875470043865856:12345-0@lo:104: Request processed in 79us (3243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587722.397586:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587722.397624:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587722.397630:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+7:8454:x1875470043865984:12345-0@lo:104: 00010000:00010000:2.0:1788587722.397638:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca81f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.397665:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788587722.397670:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+7:8454:x1875470043865984:12345-0@lo:104: Request processed in 41us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587722.397675:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587722.397687:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587722.397692:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+6:8454:x1875470043866112:12345-0@lo:104: 00010000:00010000:2.0:1788587722.397700:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca81e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.397726:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788587722.397730:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+6:8454:x1875470043866112:12345-0@lo:104: Request processed in 39us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587722.397736:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587722.397747:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788587722.397752:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+5:8454:x1875470043866240:12345-0@lo:104: 00010000:00010000:2.0:1788587722.397766:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca81d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.397794:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788587722.397798:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+5:8454:x1875470043866240:12345-0@lo:104: Request processed in 47us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587722.397804:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788587722.397815:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788587722.397820:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+4:8454:x1875470043866368:12345-0@lo:104: 00010000:00010000:2.0:1788587722.397828:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca81ad expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.397881:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788587722.397886:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+4:8454:x1875470043866368:12345-0@lo:104: Request processed in 66us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587722.397892:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788587722.397915:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587722.397922:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:8454:x1875470043866496:12345-0@lo:104: 00010000:00010000:2.0:1788587722.397935:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8183 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.397970:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788587722.397975:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:8454:x1875470043866496:12345-0@lo:104: Request processed in 54us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587722.397981:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788587722.398008:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788587722.398015:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8239 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398031:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031800 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:2.0:1788587722.398036:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca8239 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398046:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca8239 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587722.398053:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca8239 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587722.398059:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587722.398104:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8239 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398112:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587722.398136:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8239 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398143:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca8232 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8239 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398158:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788587722.398161:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca820f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398167:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481539000 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:2.0:1788587722.398170:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca820f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398203:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca820f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587722.398209:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca820f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587722.398214:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587722.398228:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca820f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398234:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587722.398257:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca820f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398264:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8208 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca820f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398275:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788587722.398278:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca81f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398284:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031a00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:2.0:1788587722.398287:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca81f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398293:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca81f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587722.398299:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca81f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587722.398310:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587722.398323:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca81f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398329:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587722.398334:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca81f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398341:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca81ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca81f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398350:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788587722.398353:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca81e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398358:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031000 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:2.0:1788587722.398361:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca81e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398367:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca81e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587722.398373:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca81e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587722.398378:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587722.398390:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca81e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398397:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587722.398408:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca81e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398415:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f480031000/0xa13e120d54ca81de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca81e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398424:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788587722.398428:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca81d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398434:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669e00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:2.0:1788587722.398437:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca81d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398443:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca81d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587722.398450:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca81d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587722.398455:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587722.398468:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca81d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398473:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587722.398478:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca81d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398484:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481669e00/0xa13e120d54ca81d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca81d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398494:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587722.398502:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca81ad expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398508:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669200 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:2.0:1788587722.398511:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca81ad expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398518:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca81ad expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587722.398524:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca81ad expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587722.398529:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587722.398542:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca81ad expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398548:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587722.398552:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca81ad expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398558:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca81a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca81ad expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398568:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587722.398571:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8183 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398578:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481539c00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:2.0:1788587722.398581:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca8183 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398600:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca8183 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587722.398603:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1788587722.398609:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca8183 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587722.398615:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587722.398629:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8183 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398635:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587722.398639:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8183 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398646:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481539c00/0xa13e120d54ca817c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8183 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.398661:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587722.398662:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587722.398664:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587722.398693:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043866624:0@lo:103: 00000100:00100000:2.0:1788587722.398742:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587722.398779:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043867136:0@lo:103: 00000100:00100000:0.0:1788587722.398793:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043866624 00000100:00100000:2.0:1788587722.398803:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587722.398804:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043866624 00000100:00100000:2.0:1788587722.398831:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788587722.398857:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f481538e00/0xa13e120d54ca8239 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8232 expref: 19 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587722.398862:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043867008:0@lo:103: 00000100:00100000:0.0:1788587722.398887:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043867136 00000100:00100000:0.0:1788587722.398891:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043867136 00000100:00100000:2.0:1788587722.398892:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587722.398906:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f480031400/0xa13e120d54ca81d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca81d0 expref: 20 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587722.398919:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043867008 00000100:00100000:0.0:1788587722.398922:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043867008 00000100:00100000:2.0:1788587722.398927:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043866880:0@lo:103: 00010000:00010000:0.0:1788587722.398932:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f481669a00/0xa13e120d54ca81e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca81de expref: 21 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587722.398951:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587722.398959:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+21:3303:x1875470043866624:12345-0@lo:103: 00000100:00100000:2.0:1788587722.398970:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587722.398972:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587722.398979:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f481538e00/0xa13e120d54ca8239 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8232 expref: 21 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587722.398986:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043867392:0@lo:103: 00010000:00010000:0.0:1788587722.398992:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f481538e00/0xa13e120d54ca8239 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca8232 expref: 21 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587722.399012:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587722.399030:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:0.0:1788587722.399033:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587722.399039:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043866752:0@lo:103: 00000100:00100000:2.0:1788587722.399069:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587722.399077:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+21:3303:x1875470043866624:12345-0@lo:103: Request processed in 118us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587722.399084:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043867264:0@lo:103: 00000100:00100000:0.0:1788587722.399087:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587722.399106:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043866880 00000100:00100000:0.0:1788587722.399110:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043866880 00000100:00100000:2.0:1788587722.399116:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587722.399129:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f480031200/0xa13e120d54ca81f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca81ec expref: 21 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587722.399139:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043867392 00000100:00100000:0.0:1788587722.399144:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043866752 00000100:00100000:2.0:1788587722.399145:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043867392 00000100:00100000:0.0:1788587722.399151:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043866752 00010000:00010000:2.0:1788587722.399168:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f481669400/0xa13e120d54ca8183 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca817c expref: 23 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587722.399187:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f481538a00/0xa13e120d54ca820f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8208 expref: 23 pid: 5835 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587722.399199:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043867264 00000100:00100000:2.0:1788587722.399204:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043867264 00000100:00100000:0.0:1788587722.399208:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788587722.399217:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+24:3303:x1875470043867136:12345-0@lo:103: 00010000:00010000:2.0:1788587722.399221:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f480030200/0xa13e120d54ca81ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca81a6 expref: 24 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587722.399227:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587722.399233:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f480031400/0xa13e120d54ca81d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca81d0 expref: 24 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587722.399241:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788587722.399244:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f480031400/0xa13e120d54ca81d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca81d0 expref: 24 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587722.399253:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+24:3303:x1875470043867008:12345-0@lo:103: 00010000:00010000:0.0:1788587722.399257:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587722.399263:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587722.399270:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f481669a00/0xa13e120d54ca81e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca81de expref: 24 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.399281:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f481669a00/0xa13e120d54ca81e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca81de expref: 24 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587722.399288:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+24:3303:x1875470043867136:12345-0@lo:103: Request processed in 71us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587722.399296:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788587722.399297:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587722.399311:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587722.399319:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+23:3305:x1875470043866880:12345-0@lo:103: 00000100:00100000:2.0:1788587722.399329:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+23:3303:x1875470043867008:12345-0@lo:103: Request processed in 77us (435us total) trans 0 rc 0/0 00010000:00010000:0.0:1788587722.399336:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587722.399343:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f480031200/0xa13e120d54ca81f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca81ec expref: 23 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587722.399351:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788587722.399357:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f480031200/0xa13e120d54ca81f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca81ec expref: 23 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587722.399368:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587722.399372:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788587722.399381:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+22:3305:x1875470043867392:12345-0@lo:103: 00010000:00010000:2.0:1788587722.399390:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587722.399396:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f481669400/0xa13e120d54ca8183 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca817c expref: 22 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587722.399401:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+22:3305:x1875470043866880:12345-0@lo:103: Request processed in 82us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587722.399414:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1788587722.399416:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f481669400/0xa13e120d54ca8183 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca817c expref: 22 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.399429:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587722.399447:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587722.399456:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1941f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+21:3305:x1875470043866752:12345-0@lo:103: 00000100:00100000:2.0:1788587722.399461:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+21:3305:x1875470043867392:12345-0@lo:103: Request processed in 80us (449us total) trans 0 rc 0/0 00010000:00010000:0.0:1788587722.399466:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788587722.399471:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788587722.399473:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f481538a00/0xa13e120d54ca820f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8208 expref: 21 pid: 5835 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587722.399484:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f481538a00/0xa13e120d54ca820f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca8208 expref: 20 pid: 5835 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587722.399490:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788587722.399498:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587722.399500:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485c36c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+20:3305:x1875470043867264:12345-0@lo:103: 00010000:00010000:2.0:1788587722.399511:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587722.399516:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f480030200/0xa13e120d54ca81ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca81a6 expref: 20 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.399527:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f480030200/0xa13e120d54ca81ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca81a6 expref: 20 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587722.399528:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1941f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+20:3305:x1875470043866752:12345-0@lo:103: Request processed in 72us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587722.399544:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1788587722.399549:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587722.399576:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485c36c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043867264:12345-0@lo:103: Request processed in 77us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587722.399582:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587722.399645:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043866752:0@lo:103: 00000100:00100000:2.0:1788587722.399664:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043867264:0@lo:103: 00000100:00100000:2.0:1788587722.399672:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043866880:0@lo:103: 00000100:00100000:2.0:1788587722.399678:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043867392:0@lo:103: 00000100:00100000:2.0:1788587722.399709:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043867008:0@lo:103: 00000100:00100000:2.0:1788587722.399717:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043866624:0@lo:103: 00000100:00100000:2.0:1788587722.399724:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043867136:0@lo:103: 00010000:00010000:3.0:1788587722.400036:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481538e00/0xa13e120d54ca8239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca8232 expref: 18 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.400051:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4867b5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043865728:0@lo:104: 00010000:00010000:3.0:1788587722.400063:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481538a00/0xa13e120d54ca820f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca8208 expref: 17 pid: 5835 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.400070:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4867b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043865856:0@lo:104: 00010000:00010000:3.0:1788587722.400080:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f480031200/0xa13e120d54ca81f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca81ec expref: 16 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.400088:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4867b7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043865984:0@lo:104: 00010000:00010000:3.0:1788587722.400099:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481669a00/0xa13e120d54ca81e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca81de expref: 15 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.400108:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4867b7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043866112:0@lo:104: 00010000:00010000:3.0:1788587722.400118:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f480031400/0xa13e120d54ca81d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca81d0 expref: 14 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.400125:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4806a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043866240:0@lo:104: 00010000:00010000:3.0:1788587722.400134:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f480030200/0xa13e120d54ca81ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca81a6 expref: 13 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.400143:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c94e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043866368:0@lo:104: 00010000:00010000:3.0:1788587722.400152:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481669400/0xa13e120d54ca8183 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca817c expref: 12 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.400194:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c94700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043866496:0@lo:104: 00000100:00100000:3.0:1788587722.400478:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4867b6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043865472:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587722.400488:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4867b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875470043865600:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587722.400530:0:8454:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587722.401138:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:0.0:1788587722.408193:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587722.408278:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026019072 00000100:00100000:2.0:1788587722.408291:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026019072 00000100:00100000:2.0:1788587722.408364:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 130 00000100:00100000:2.0:1788587722.408379:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5587:x1875470026019072:12345-192.168.206.33@tcp:101: 00010000:00010000:2.0:1788587722.408401:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587722.408423:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f481539c00/0xa13e120d54ca828d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1060 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.408457:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.408469:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88f481539c00/0xa13e120d54ca828d lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1060 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.408490:0:5836:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.408514:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f481539c00/0xa13e120d54ca828d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1060 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587722.408559:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481539c00, rc 0) 00000100:00100000:2.0:1788587722.408635:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:5587:x1875470026019072:12345-192.168.206.33@tcp:101: Request processed in 260us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587722.408643:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 130 00000100:00100000:1.0:1788587722.411435:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587722.411559:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587722.412282:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026018816 00000100:00100000:0.0:1788587722.412296:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026018816 00010000:00010000:0.0:1788587722.412348:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4baed4400/0xa13e120d54ca824e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ffe expref: 11 pid: 5835 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587722.412488:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026018944 00000100:00100000:0.0:1788587722.412493:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026018944 00010000:00010000:0.0:1788587722.412509:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca8247 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ff7 expref: 12 pid: 5835 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.412546:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 19 00000100:00100000:3.0:1788587722.412559:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:2346:x1875470026018816:12345-192.168.206.33@tcp:103: 00010000:00010000:3.0:1788587722.412578:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587722.412586:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4baed4400/0xa13e120d54ca824e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ffe expref: 12 pid: 5835 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412600:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4baed4400/0xa13e120d54ca824e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ffe expref: 12 pid: 5835 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412623:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed4400/0xa13e120d54ca824e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ffe expref: 12 pid: 5835 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412643:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587722.412722:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:2346:x1875470026018816:12345-192.168.206.33@tcp:103: Request processed in 165us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587722.412730:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 19 00000100:00100000:3.0:1788587722.412757:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 20 00000100:00100000:3.0:1788587722.412763:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2346:x1875470026018944:12345-192.168.206.33@tcp:103: 00010000:00010000:3.0:1788587722.412772:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587722.412783:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca8247 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ff7 expref: 10 pid: 5835 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412793:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca8247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ff7 expref: 10 pid: 5835 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412804:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca8247 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db0ff7 expref: 10 pid: 5835 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412816:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412824:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412868:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412876:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412884:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412891:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412897:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:3.0:1788587722.412902:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412911:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412932:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88f481539c00/0xa13e120d54ca828d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1060 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412940:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f481539c00/0xa13e120d54ca828d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1060 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.412968:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff88f481539c00/0xa13e120d54ca828d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1060 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.412983:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c94700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:MGS:5826:1875470043867520:192.168.206.33@tcp:105: 00000100:00100000:3.0:1788587722.413051:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4857a0300 going to sleep for 11 seconds 00010000:00010000:3.0:1788587722.413076:0:8454:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.413085:0:8454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587722.418167:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c94700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:MGS:5826:1875470043867520:192.168.206.33@tcp:105: 00010000:00010000:3.0:1788587722.418218:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.418234:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8286 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587722.418250:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587722.419641:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:2346:x1875470026018944:12345-192.168.206.33@tcp:103: Request processed in 6864us (8068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587722.419655:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 20 00000100:00100000:1.0:1788587722.420347:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587722.422719:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026019200 00000100:00100000:2.0:1788587722.422833:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026019200 00000100:00100000:2.0:1788587722.422926:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 131 00000100:00100000:2.0:1788587722.422936:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:5587:x1875470026019200:12345-192.168.206.33@tcp:501: 00000100:00100000:2.0:1788587722.423316:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:5587:x1875470026019200:12345-192.168.206.33@tcp:501: Request processed in 380us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587722.423324:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 131 00000100:00100000:0.0:1788587722.451305:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587722.451406:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026019328 00000100:00100000:1.0:1788587722.451419:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026019328 00000100:00100000:1.0:1788587722.451490:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 132 00000100:00100000:1.0:1788587722.451502:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:5587:x1875470026019328:12345-192.168.206.33@tcp:503: 00000100:00100000:1.0:1788587722.452421:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:5587:x1875470026019328:12345-192.168.206.33@tcp:503: Request processed in 916us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587722.452432:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 132 00000100:00100000:1.0:1788587722.455451:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587722.455548:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026019456 00000100:00100000:3.0:1788587722.455562:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026019456 00000100:00100000:3.0:1788587722.455629:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 133 00000100:00100000:3.0:1788587722.455640:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:6048:x1875470026019456:12345-192.168.206.33@tcp:502: 00000100:00100000:3.0:1788587722.456045:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:6048:x1875470026019456:12345-192.168.206.33@tcp:502: Request processed in 404us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587722.456054:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 133 00000100:00100000:0.0:1788587722.464351:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587722.464405:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026019584 00000100:00100000:0.0:1788587722.464416:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026019584 00000100:00100000:0.0:1788587722.471147:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 134 00000100:00100000:0.0:1788587722.471171:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:6048:x1875470026019584:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587722.471519:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:6048:x1875470026019584:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 355us (7180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587722.471528:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 134 00000100:00100000:0.0:1788587722.476120:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587722.476551:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026019712 00000100:00100000:1.0:1788587722.476564:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026019712 00000100:00100000:1.0:1788587722.476630:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 135 00000100:00100000:1.0:1788587722.476642:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:5587:x1875470026019712:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587722.476685:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587722.476708:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f481669e00/0xa13e120d54ca8294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1067 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587722.477123:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f481669e00/0xa13e120d54ca8294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1067 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587722.477138:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f481669e00/0xa13e120d54ca8294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1067 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587722.477150:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481669e00, rc 0) 00000100:00100000:1.0:1788587722.477333:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5587:x1875470026019712:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 Request processed in 692us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587722.477341:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 135 00000100:00100000:1.0:1788587722.485607:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587722.485656:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026019840 00000100:00100000:1.0:1788587722.485667:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026019840 00000100:00100000:1.0:1788587722.485777:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 136 00000100:00100000:1.0:1788587722.485793:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5587:x1875470026019840:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587722.486242:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5587:x1875470026019840:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 Request processed in 451us (646us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587722.486252:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 136 00000100:00100000:0.0:1788587722.697163:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043867776:0@lo:400: 00000100:00100000:3.0:1788587722.697356:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043867648:0@lo:13: 00000100:00100000:1.0:1788587722.697367:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587722.697430:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043867776 00000100:00100000:0.0:1788587722.697440:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043867776 00000100:00100000:0.0:1788587722.697503:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788587722.697513:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043867776:12345-0@lo:400: 00000100:00100000:3.0:1788587722.700317:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587722.700417:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043868160:0@lo:400: 00000100:00100000:3.0:1788587722.700469:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587722.700506:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587722.700513:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043868288:0@lo:400: 00000100:00100000:3.0:1788587722.700541:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587722.700582:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043867904:0@lo:400: 00000100:00100000:3.0:1788587722.700607:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587722.700627:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587722.700634:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043868032:0@lo:400: 00000100:00100000:1.0:1788587722.700851:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043868160 00000100:00100000:1.0:1788587722.700864:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043868160 00000100:00100000:3.0:1788587722.700878:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587722.700925:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043867904 00000100:00100000:1.0:1788587722.700929:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043867904 00000100:00100000:3.0:1788587722.700934:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788587722.700948:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043868160:12345-0@lo:400: 00000100:00100000:1.0:1788587722.700950:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788587722.700970:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:1.0:1788587722.700987:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587722.701062:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043867776:12345-0@lo:400: Request processed in 3546us (3697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587722.701073:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788587722.701101:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788587722.701110:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043867904:12345-0@lo:400: 00000100:00100000:1.0:1788587722.701128:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043867776:0@lo:400: 00000100:00100000:3.0:1788587722.701137:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043868160:12345-0@lo:400: Request processed in 190us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587722.701147:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587722.701172:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043867904:12345-0@lo:400: Request processed in 62us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587722.701192:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788587722.701195:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043867648 00000100:00100000:3.0:1788587722.701201:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043867648 00000100:00080000:0.0:1788587722.701255:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587722.701271:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587722.701278:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043867648:12345-0@lo:13: 00002000:00000024:3.0:1788587722.701315:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587722.701355:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043867648:12345-0@lo:13: Request processed in 78us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587722.701361:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587722.701383:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043868288 00000100:00100000:3.0:1788587722.701387:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043868288 00000100:00100000:3.0:1788587722.701416:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043868032 00000100:00100000:3.0:1788587722.701419:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043868032 00000100:00100000:3.0:1788587722.701434:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587722.701440:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043868288:12345-0@lo:400: 00000100:00100000:3.0:1788587722.701470:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043868288:12345-0@lo:400: Request processed in 30us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587722.701476:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587722.701486:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587722.701492:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043868032:12345-0@lo:400: 00000100:00100000:3.0:1788587722.701520:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043868032:12345-0@lo:400: Request processed in 29us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587722.701526:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788587722.701567:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b4c94a80 x1875470043868032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587722.701580:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043868032:0@lo:400: 00000100:00100000:3.0:1788587722.701593:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043867904:0@lo:400: 00010000:00080000:3.0:1788587722.701619:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b4c97b80 x1875470043868288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587722.701639:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043868288:0@lo:400: 00010000:00080000:3.0:1788587722.701650:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6fa300 x1875470043867648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587722.701814:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043867648:0@lo:13: 00000100:00100000:3.0:1788587722.701829:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043868160:0@lo:400: 00010000:00010000:3.0:1788587723.208834:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788587723.319525:0:8507:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef3f529b0 20000000:00000080:3.0:1788587723.319541:0:8507:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88f4bb270c00 uarg=0000000000000000 20000000:01000000:3.0:1788587723.319575:0:8507:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788587723.319581:0:8507:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788587723.319585:0:8507:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788587723.320582:0:8508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788587723.321216:0:8507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788587723.325798:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788587723.326104:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788587723.326187:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788587723.326207:0:8507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788587723.326226:0:8507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.326246:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f480030800/0xa13e120d54ca80c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca80bf expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.326255:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4c21d4000/0xa13e120d54ca8144 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca813d expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.326262:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f481669600/0xa13e120d54ca819f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8198 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.326285:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca825c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db102f expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.326294:0:8507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.326333:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca825c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db102f expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.326348:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca825c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db102f expref: 9 pid: 5835 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587723.326364:0:8507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875470043868416:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587723.326514:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f481669600/0xa13e120d54ca819f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca8198 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.326523:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f481669600/0xa13e120d54ca819f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca8198 expref: 11 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587723.326532:0:8507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c97b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875470043868544:0@lo:104: 00000100:00100000:3.0:1788587723.326570:0:8507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587723.326613:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4c21d4000/0xa13e120d54ca8144 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca813d expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.326621:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f4c21d4000/0xa13e120d54ca8144 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca813d expref: 11 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587723.326628:0:8507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c94a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875470043868672:0@lo:104: 00000100:00100000:3.0:1788587723.326662:0:8507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587723.326701:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f480030800/0xa13e120d54ca80c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca80bf expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.326709:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f480030800/0xa13e120d54ca80c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca80bf expref: 11 pid: 5834 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587723.326718:0:8507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875470043868800:0@lo:104: 00000100:00100000:3.0:1788587723.326735:0:8507:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4857a0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587723.326876:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788587723.326894:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587723.326907:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043868544 00000100:00100000:0.0:1788587723.326913:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043868544 00000100:00100000:0.0:1788587723.326947:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043868672 00000100:00100000:0.0:1788587723.326951:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043868672 00000100:00100000:0.0:1788587723.326961:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043868800 00000100:00100000:0.0:1788587723.326964:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043868800 00000100:00100000:0.0:1788587723.326976:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788587723.326995:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+5:8507:x1875470043868544:12345-0@lo:104: 00010000:00010000:0.0:1788587723.327007:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca819f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327063:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587723.327069:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+5:8507:x1875470043868544:12345-0@lo:104: Request processed in 87us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587723.327076:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788587723.327092:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788587723.327098:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb02c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+4:8507:x1875470043868672:12345-0@lo:104: 00010000:00010000:0.0:1788587723.327106:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8144 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327135:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788587723.327139:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb02c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+4:8507:x1875470043868672:12345-0@lo:104: Request processed in 43us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587723.327152:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788587723.327195:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587723.327201:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:8507:x1875470043868800:12345-0@lo:104: 00010000:00010000:0.0:1788587723.327208:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca80bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca80c6 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327232:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788587723.327236:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:8507:x1875470043868800:12345-0@lo:104: Request processed in 37us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587723.327242:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788587723.327257:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788587723.327263:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca819f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327269:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5400 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:0.0:1788587723.327273:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca819f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327281:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca819f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587723.327289:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca819f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587723.327295:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587723.327322:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca819f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327329:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587723.327351:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca819f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327358:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f4baed5400/0xa13e120d54ca8198 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca819f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327370:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587723.327373:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8144 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327378:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c21d5400 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:0.0:1788587723.327381:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca8144 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327387:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca8144 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587723.327393:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca8144 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587723.327398:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587723.327409:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8144 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327414:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587723.327419:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8144 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327424:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f4c21d5400/0xa13e120d54ca813d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8144 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327433:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587723.327442:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca80bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca80c6 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327448:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030600 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:0.0:1788587723.327451:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca80bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca80c6 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327458:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca80bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca80c6 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587723.327464:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca80bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca80c6 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587723.327469:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587723.327482:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca80bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca80c6 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327487:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587723.327501:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca80bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca80c6 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327507:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca80bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca80c6 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327520:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587723.327521:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587723.327523:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587723.327529:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587723.327544:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043868928:0@lo:103: 00000100:00100000:0.0:1788587723.327572:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587723.327601:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587723.327612:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043869056:0@lo:103: 00000100:00100000:0.0:1788587723.327633:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587723.327657:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043869184:0@lo:103: 00000100:00100000:0.0:1788587723.327690:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587723.327720:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043868928 00000100:00100000:0.0:1788587723.327724:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043868928 00010000:00010000:0.0:1788587723.327742:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f481669600/0xa13e120d54ca819f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8198 expref: 12 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587723.327760:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043869056 00000100:00100000:0.0:1788587723.327763:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043869056 00010000:00010000:0.0:1788587723.327772:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4c21d4000/0xa13e120d54ca8144 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca813d expref: 13 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587723.327780:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043869184 00000100:00100000:0.0:1788587723.327782:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043869184 00010000:00010000:0.0:1788587723.327789:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f480030800/0xa13e120d54ca80c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca80bf expref: 14 pid: 5834 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587723.327799:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587723.327805:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:3304:x1875470043868928:12345-0@lo:103: 00010000:00010000:0.0:1788587723.327814:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587723.327818:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f481669600/0xa13e120d54ca819f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8198 expref: 14 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327828:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f481669600/0xa13e120d54ca819f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca8198 expref: 14 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327866:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587723.327892:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:3304:x1875470043868928:12345-0@lo:103: Request processed in 88us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587723.327906:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587723.327919:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788587723.327925:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:3304:x1875470043869056:12345-0@lo:103: 00010000:00010000:0.0:1788587723.327932:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587723.327937:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4c21d4000/0xa13e120d54ca8144 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca813d expref: 13 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327946:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4c21d4000/0xa13e120d54ca8144 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca813d expref: 13 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.327956:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587723.327975:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:3304:x1875470043869056:12345-0@lo:103: Request processed in 50us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587723.327981:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788587723.327990:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587723.327995:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:3302:x1875470043869184:12345-0@lo:103: 00010000:00010000:0.0:1788587723.328002:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587723.328006:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f480030800/0xa13e120d54ca80c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca80bf expref: 12 pid: 5834 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.328015:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f480030800/0xa13e120d54ca80c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca80bf expref: 12 pid: 5834 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.328023:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587723.328043:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:3302:x1875470043869184:12345-0@lo:103: Request processed in 47us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587723.328049:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587723.328081:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043869184:0@lo:103: 00000100:00100000:0.0:1788587723.328110:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043869056:0@lo:103: 00000100:00100000:0.0:1788587723.328117:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043868928:0@lo:103: 00010000:00010000:3.0:1788587723.328584:0:8507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481669600/0xa13e120d54ca819f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca8198 expref: 11 pid: 5836 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587723.328596:0:8507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c97b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875470043868544:0@lo:104: 00010000:00010000:3.0:1788587723.328606:0:8507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4c21d4000/0xa13e120d54ca8144 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca813d expref: 10 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587723.328615:0:8507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c94a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875470043868672:0@lo:104: 00010000:00010000:3.0:1788587723.328622:0:8507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f480030800/0xa13e120d54ca80c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca80bf expref: 9 pid: 5834 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587723.328631:0:8507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875470043868800:0@lo:104: 00000100:00100000:0.0:1788587723.333675:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587723.333760:0:8507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875470043868416:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587723.333797:0:8507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587723.334341:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026019968 00000100:00100000:2.0:1788587723.334348:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026019968 00010000:00010000:2.0:1788587723.334380:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca825c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db102f expref: 10 pid: 5835 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587723.334416:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 24 00000100:00100000:2.0:1788587723.334425:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2344:x1875470026019968:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587723.334438:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587723.334444:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca825c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db102f expref: 10 pid: 5835 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.334455:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca825c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db102f expref: 10 pid: 5835 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.334471:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca825c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db102f expref: 10 pid: 5835 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.334499:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.334507:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.334522:0:6708:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.334529:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.334535:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.334542:0:6708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.334549:0:6708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5800 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587723.334553:0:6708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.334561:0:6708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.334805:0:8507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.334814:0:8507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.335873:0:6708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.335887:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed5800/0xa13e120d54ca829b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.335914:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587723.335978:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:2344:x1875470026019968:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 1552us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587723.335986:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 24 10000000:01000000:0.0:1788587723.615959:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788587723.615966:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88f4b487a800 from 39 10000000:01000000:0.0:1788587723.615970:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788587723.616012:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.616023:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.616032:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587723.616053:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043869312:0@lo:101: 00000100:00100000:0.0:1788587723.616115:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587723.616215:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b50d2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587723.616489:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043869312 00000100:00100000:1.0:1788587723.616497:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043869312 00000100:00100000:1.0:1788587723.616548:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788587723.616557:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+9:5838:x1875470043869312:12345-0@lo:101: 00010000:00010000:1.0:1788587723.616568:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587723.616587:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f481668200/0xa13e120d54ca82a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca82a2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.616610:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f481668200/0xa13e120d54ca82a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca82a2 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.616619:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f481668200/0xa13e120d54ca82a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca82a2 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.616627:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481668200, rc 0) 00000100:00100000:1.0:1788587723.616804:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:5838:x1875470043869312:12345-0@lo:101: Request processed in 247us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587723.616811:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788587723.616909:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043869312:0@lo:101: 00010000:00010000:0.0:1788587723.616923:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.616932:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca82a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587723.616982:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043869440:0@lo:501: 00000100:00100000:0.0:1788587723.617007:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587723.617050:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b50d2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587723.619340:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043869440 00000100:00100000:1.0:1788587723.619353:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043869440 00000100:00100000:1.0:1788587723.619466:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788587723.619476:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:5838:x1875470043869440:12345-0@lo:501: 00000100:00100000:1.0:1788587723.619763:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:5838:x1875470043869440:12345-0@lo:501: Request processed in 287us (2754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587723.619770:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788587723.619887:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043869440:0@lo:501: 00000100:00100000:0.0:1788587723.619932:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043869568:0@lo:503: 00000100:00100000:0.0:1788587723.619974:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587723.621925:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b50d2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.622016:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043869568 00000100:00100000:2.0:1788587723.622024:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043869568 00000100:00100000:2.0:1788587723.622065:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788587723.622074:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:5838:x1875470043869568:12345-0@lo:503: 00000100:00100000:2.0:1788587723.622478:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:5838:x1875470043869568:12345-0@lo:503: Request processed in 404us (2502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587723.622486:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788587723.622583:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043869568:0@lo:503: 00000100:00100000:0.0:1788587723.623622:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8520:1875470043869696:0@lo:502: 00000100:00100000:0.0:1788587723.623790:0:8520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587723.623880:0:8520:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b50d2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587723.624362:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043869696 00000100:00100000:1.0:1788587723.624376:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043869696 00000100:00100000:1.0:1788587723.624466:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788587723.624475:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:8520:x1875470043869696:12345-0@lo:502: 00000100:00100000:1.0:1788587723.624919:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:8520:x1875470043869696:12345-0@lo:502: Request processed in 443us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587723.624926:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788587723.625013:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8520:1875470043869696:0@lo:502: 00000100:00100000:0.0:1788587723.625063:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8520:1875470043869824:0@lo:502: 00000100:00100000:0.0:1788587723.625098:0:8520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587723.625387:0:8520:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b50d2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.625584:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043869824 00000100:00100000:2.0:1788587723.625589:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043869824 00000100:00100000:2.0:1788587723.625617:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788587723.625624:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:8520:x1875470043869824:12345-0@lo:502: 00000100:00100000:2.0:1788587723.625816:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:8520:x1875470043869824:12345-0@lo:502: Request processed in 192us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587723.625823:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788587723.625929:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8520:1875470043869824:0@lo:502: 00000040:00080000:0.0:1788587723.625951:0:8520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788587723.626363:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788587723.626386:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788587723.626395:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.626406:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587723.626416:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788587723.626426:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788587723.626428:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788587723.626453:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.626462:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.626470:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587723.626486:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043869952:0@lo:101: 00000100:00100000:2.0:1788587723.626517:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587723.626552:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48575d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587723.626600:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043869952 00000100:00100000:0.0:1788587723.626605:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043869952 00000100:00100000:0.0:1788587723.626628:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788587723.626634:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+10:5838:x1875470043869952:12345-0@lo:101: 00010000:00010000:0.0:1788587723.626644:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587723.626667:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bf77a000/0xa13e120d54ca82b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca82b0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.626688:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bf77a000/0xa13e120d54ca82b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca82b0 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.626710:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bf77a000/0xa13e120d54ca82b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca82b0 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.626719:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a000, rc 0) 00000100:00100000:0.0:1788587723.626756:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5838:x1875470043869952:12345-0@lo:101: Request processed in 122us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587723.626762:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788587723.626827:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043869952:0@lo:101: 00010000:00010000:2.0:1788587723.626838:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.626877:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca82b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587723.626922:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043870080:0@lo:501: 00000100:00100000:2.0:1788587723.626946:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587723.626956:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48575d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587723.627030:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043870080 00000100:00100000:0.0:1788587723.627035:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043870080 00000100:00100000:0.0:1788587723.627052:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788587723.627057:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5838:x1875470043870080:12345-0@lo:501: 00000100:00100000:0.0:1788587723.627295:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5838:x1875470043870080:12345-0@lo:501: Request processed in 237us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587723.627302:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788587723.627489:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043870080:0@lo:501: 00000100:00100000:2.0:1788587723.627515:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043870208:0@lo:503: 00000100:00100000:2.0:1788587723.627550:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587723.627588:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48575d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587723.628044:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043870208 00000100:00100000:0.0:1788587723.628049:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043870208 00000100:00100000:0.0:1788587723.628071:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788587723.628077:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5838:x1875470043870208:12345-0@lo:503: 00000100:00100000:0.0:1788587723.628366:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5838:x1875470043870208:12345-0@lo:503: Request processed in 288us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587723.628373:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788587723.628458:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043870208:0@lo:503: 00000100:00100000:2.0:1788587723.628886:0:8521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8521:1875470043870336:0@lo:502: 00000100:00100000:2.0:1788587723.628925:0:8521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587723.628951:0:8521:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48575d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587723.629010:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043870336 00000100:00100000:0.0:1788587723.629015:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043870336 00000100:00100000:0.0:1788587723.629048:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788587723.629055:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:8521:x1875470043870336:12345-0@lo:502: 00000100:00100000:0.0:1788587723.629835:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:8521:x1875470043870336:12345-0@lo:502: Request processed in 778us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587723.629884:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788587723.630338:0:8521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8521:1875470043870336:0@lo:502: 00000020:01000000:2.0:1788587723.630366:0:8521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587723.630375:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587723.630377:0:8521:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788587723.630383:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788587723.630411:0:8521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8521:1875470043870464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587723.630450:0:8521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587723.630518:0:8521:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48575d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587723.630550:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043870464 00000100:00100000:1.0:1788587723.630555:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043870464 00000100:00100000:1.0:1788587723.630618:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788587723.630626:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:8521:x1875470043870464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587723.630783:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:8521:x1875470043870464:12345-0@lo:502:llog_process_th.0 Request processed in 158us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587723.630791:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788587723.630864:0:8521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8521:1875470043870464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587723.630883:0:8521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587723.630887:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587723.630889:0:8521:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788587723.630893:0:8521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788587723.631051:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788587723.631073:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788587723.631082:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.631093:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587723.631102:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788587723.631104:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f4b487a800 from 4 10000000:01000000:3.0:1788587723.631107:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587723.631142:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.631151:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.631161:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587723.631187:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043870592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.631216:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.631494:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4857a0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587723.631554:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043870592 00000100:00100000:0.0:1788587723.631559:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043870592 00000100:00100000:0.0:1788587723.631581:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788587723.631587:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+11:5838:x1875470043870592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587723.631595:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587723.631607:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bf77a800/0xa13e120d54ca82c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca82be expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.631627:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bf77a800/0xa13e120d54ca82c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca82be expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.631639:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bf77a800/0xa13e120d54ca82c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca82be expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587723.631648:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a800, rc 0) 00000100:00100000:0.0:1788587723.631687:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043870592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587723.631693:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788587723.631758:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043870592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587723.631770:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82c5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.631780:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca82c5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587723.634635:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043870720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.634702:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.634736:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4857a0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.634767:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043870720 00000100:00100000:3.0:1788587723.634773:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043870720 00000100:00100000:3.0:1788587723.634807:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788587723.634815:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043870720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.635071:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043870720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.635078:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788587723.635135:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043870720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.635180:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043870848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.635218:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.635232:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4857a0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.635323:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043870848 00000100:00100000:3.0:1788587723.635326:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043870848 00000100:00100000:3.0:1788587723.635344:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788587723.635351:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043870848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.635480:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043870848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.635487:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788587723.635522:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043870848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.635695:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8522:1875470043870976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.635732:0:8522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.635749:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043870976 00000100:00100000:3.0:1788587723.635752:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043870976 00000100:00100000:3.0:1788587723.635769:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788587723.635775:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:8522:x1875470043870976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.635910:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:8522:x1875470043870976:12345-0@lo:502:llog_process_th.0 Request processed in 134us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.635917:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788587723.635942:0:8522:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486647cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.635953:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8522:1875470043870976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587723.635973:0:8522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587723.635982:0:8522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587723.635984:0:8522:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788587723.635991:0:8522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88f4b487a800 00000020:00000080:3.0:1788587723.635993:0:8522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788587723.636057:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8522:1875470043871104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.636085:0:8522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.636101:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043871104 00000100:00100000:3.0:1788587723.636104:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043871104 00000100:00100000:3.0:1788587723.636120:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788587723.636126:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:8522:x1875470043871104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.636231:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:8522:x1875470043871104:12345-0@lo:502:llog_process_th.0 Request processed in 105us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.638793:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788587723.639078:0:8522:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486647cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.639107:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8522:1875470043871104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587723.639220:0:8522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587723.639227:0:8522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587723.639229:0:8522:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788587723.639914:0:8522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788587723.645559:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788587723.645595:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587723.645607:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82c5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.645621:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82c5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587723.645633:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788587723.645636:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88f4baee9800 from 39 10000000:01000000:2.0:1788587723.645640:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788587723.645702:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.645709:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.645721:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587723.645746:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043871232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.645812:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587723.649519:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48575d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.651213:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043871232 00000100:00100000:3.0:1788587723.651226:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043871232 00000100:00100000:3.0:1788587723.651426:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788587723.651436:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+12:5838:x1875470043871232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587723.651452:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587723.651467:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4baed4400/0xa13e120d54ca82d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca82cc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.651494:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed4400/0xa13e120d54ca82d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca82cc expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.651504:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4baed4400/0xa13e120d54ca82d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca82cc expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.651513:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed4400, rc 0) 00000100:00100000:3.0:1788587723.651592:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:5838:x1875470043871232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (5779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.651599:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788587723.651681:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043871232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587723.651699:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.651708:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587723.651775:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043871360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.651807:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587723.660400:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491ee76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.661631:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043871360 00000100:00100000:2.0:1788587723.661650:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043871360 00000100:00100000:2.0:1788587723.661703:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788587723.661713:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:5838:x1875470043871360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.662024:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:5838:x1875470043871360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (10215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587723.662032:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788587723.662097:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043871360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.662147:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043871488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.662200:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587723.662217:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48575d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.662230:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043871488 00000100:00100000:2.0:1788587723.662623:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043871488 00000100:00100000:2.0:1788587723.662648:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788587723.662655:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:5838:x1875470043871488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.662806:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:5838:x1875470043871488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587723.662813:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788587723.662872:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043871488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.666423:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8525:1875470043871616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.666493:0:8525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.666535:0:8525:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4866470c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.666722:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043871616 00000100:00100000:2.0:1788587723.666731:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043871616 00000100:00100000:2.0:1788587723.666775:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788587723.666783:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:8525:x1875470043871616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587723.667047:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:8525:x1875470043871616:12345-0@lo:502:llog_process_th.0 Request processed in 264us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587723.667055:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788587723.669401:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8525:1875470043871616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587723.669478:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8525:1875470043871744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587723.669543:0:8525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587723.669586:0:8525:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b50d29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.669637:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043871744 00000100:00100000:2.0:1788587723.669643:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043871744 00000100:00100000:2.0:1788587723.669687:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788587723.669695:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:8525:x1875470043871744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587723.669949:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:8525:x1875470043871744:12345-0@lo:502:llog_process_th.0 Request processed in 254us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587723.669958:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788587723.670043:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8525:1875470043871744:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788587723.670062:0:8525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788587723.670439:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788587723.670473:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788587723.670483:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.670494:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587723.670514:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788587723.670517:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788587723.670520:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788587723.670544:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.670553:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.670562:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587723.670578:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043871872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.670608:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587723.670640:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48575de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.675820:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043871872 00000100:00100000:3.0:1788587723.675833:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043871872 00000100:00100000:3.0:1788587723.675899:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788587723.675908:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+13:5838:x1875470043871872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587723.675936:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587723.675953:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4baed4e00/0xa13e120d54ca82e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca82da expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.675982:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed4e00/0xa13e120d54ca82e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca82da expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.675993:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4baed4e00/0xa13e120d54ca82e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca82da expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.676002:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed4e00, rc 0) 00000100:00100000:3.0:1788587723.676075:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043871872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (5466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.676083:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788587723.676207:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043871872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587723.676224:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.676256:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca82e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587723.676322:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043872000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.676355:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587723.676389:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491ee76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.676504:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043872000 00000100:00100000:2.0:1788587723.676509:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043872000 00000100:00100000:2.0:1788587723.676542:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788587723.676549:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043872000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.676767:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043872000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587723.676774:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788587723.681389:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043872000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.681449:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043872128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.681529:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587723.681575:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491ee76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587723.681596:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043872128 00000100:00100000:1.0:1788587723.681602:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043872128 00000100:00100000:1.0:1788587723.681650:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788587723.681659:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043872128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.681833:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043872128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587723.681857:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788587723.681895:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043872128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.684279:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8526:1875470043872256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587723.684343:0:8526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587723.684385:0:8526:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488b99840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.684511:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043872256 00000100:00100000:3.0:1788587723.684517:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043872256 00000100:00100000:3.0:1788587723.684564:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788587723.684572:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:8526:x1875470043872256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.684775:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:8526:x1875470043872256:12345-0@lo:502:llog_process_th.0 Request processed in 203us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.684783:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788587723.687694:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8526:1875470043872256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587723.687736:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587723.687753:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587723.687755:0:8526:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788587723.687760:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788587723.687796:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8526:1875470043872384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587723.687873:0:8526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587723.687964:0:8526:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488b99840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.700987:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043872384 00000100:00100000:2.0:1788587723.701003:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043872384 00000100:00100000:1.0:1788587723.703449:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788587723.703465:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:8526:x1875470043872384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587723.703757:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:8526:x1875470043872384:12345-0@lo:502:llog_process_th.0 Request processed in 296us (15882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587723.703765:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788587723.704143:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8526:1875470043872384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587723.704193:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587723.704202:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587723.704204:0:8526:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788587723.704209:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788587723.704336:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788587723.704359:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788587723.704369:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.704388:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587723.704397:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788587723.704399:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f4baee9800 from 4 10000000:01000000:2.0:1788587723.704401:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587723.704430:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.704437:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.704445:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587723.704469:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043872512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.704508:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587723.704543:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f493590cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.705637:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043872512 00000100:00100000:3.0:1788587723.705646:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043872512 00000100:00100000:3.0:1788587723.705704:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788587723.705713:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:5838:x1875470043872512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587723.705725:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587723.705738:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4baed5c00/0xa13e120d54ca82ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca82e8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.705762:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed5c00/0xa13e120d54ca82ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca82e8 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.705773:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4baed5c00/0xa13e120d54ca82ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca82e8 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.705781:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed5c00, rc 0) 00000100:00100000:3.0:1788587723.705836:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043872512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.705863:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788587723.705892:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043872512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587723.706224:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82ef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.706306:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca82ef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587723.706367:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043872640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.706401:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587723.706440:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f493590cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587723.706493:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043872640 00000100:00100000:1.0:1788587723.706498:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043872640 00000100:00100000:1.0:1788587723.706526:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788587723.706533:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043872640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.706774:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043872640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587723.706782:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788587723.707260:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043872640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.707290:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043872768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.707344:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587723.707363:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f493590cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.707505:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043872768 00000100:00100000:3.0:1788587723.707511:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043872768 00000100:00100000:3.0:1788587723.707535:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788587723.707543:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043872768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.707700:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043872768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.707707:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788587723.709525:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043872768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.713771:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8527:1875470043872896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587723.713865:0:8527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.713898:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043872896 00000100:00100000:1.0:1788587723.713906:0:8527:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491ee76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.713907:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043872896 00000100:00100000:3.0:1788587723.713969:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788587723.713978:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:8527:x1875470043872896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.714216:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:8527:x1875470043872896:12345-0@lo:502:llog_process_th.0 Request processed in 240us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.714231:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788587723.714506:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8527:1875470043872896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587723.714534:0:8527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587723.714544:0:8527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587723.714546:0:8527:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788587723.714553:0:8527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88f4baee9800 00000020:00000080:1.0:1788587723.714556:0:8527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788587723.714635:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8527:1875470043873024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587723.714669:0:8527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587723.714698:0:8527:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4830220c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.715054:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043873024 00000100:00100000:3.0:1788587723.715060:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043873024 00000100:00100000:3.0:1788587723.715091:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788587723.715098:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:8527:x1875470043873024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.715303:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:8527:x1875470043873024:12345-0@lo:502:llog_process_th.0 Request processed in 204us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.715311:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788587723.721640:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8527:1875470043873024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587723.721706:0:8527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587723.721714:0:8527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587723.721716:0:8527:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788587723.721720:0:8527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788587723.724896:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788587723.724925:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587723.724936:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82ef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.724957:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82ef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587723.724967:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788587723.724970:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88f488106000 from 39 10000000:01000000:1.0:1788587723.724973:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788587723.725015:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.725030:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.725041:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587723.725067:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043873152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.725135:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587723.725204:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491ee76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.727367:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043873152 00000100:00100000:3.0:1788587723.727378:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043873152 00000100:00100000:3.0:1788587723.727424:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788587723.727433:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:5838:x1875470043873152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587723.727449:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587723.727466:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4baed4600/0xa13e120d54ca82fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca82f6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.727490:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed4600/0xa13e120d54ca82fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca82f6 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.727499:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4baed4600/0xa13e120d54ca82fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca82f6 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.727507:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed4600, rc 0) 00000100:00100000:3.0:1788587723.727572:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043873152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (2437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.727579:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788587723.727627:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043873152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587723.727651:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.727661:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587723.728382:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043873280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.728425:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.728446:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486647240 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.728464:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043873280 00000100:00100000:3.0:1788587723.728469:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043873280 00000100:00100000:3.0:1788587723.728498:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788587723.728505:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043873280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.728708:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043873280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.728716:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788587723.728753:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043873280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.728878:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043873408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.728919:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.728946:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486647240 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.728960:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043873408 00000100:00100000:3.0:1788587723.728964:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043873408 00000100:00100000:3.0:1788587723.728983:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788587723.728988:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043873408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.729138:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043873408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.729423:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788587723.729464:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043873408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.729633:0:8529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8529:1875470043873536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.729668:0:8529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.729692:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043873536 00000100:00100000:3.0:1788587723.729696:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043873536 00000100:00100000:3.0:1788587723.729723:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788587723.729729:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:8529:x1875470043873536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.730007:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:8529:x1875470043873536:12345-0@lo:502:llog_process_th.0 Request processed in 276us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.730029:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788587723.730061:0:8529:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4857a0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.730074:0:8529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8529:1875470043873536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.730114:0:8529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8529:1875470043873664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.730145:0:8529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.730414:0:8529:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4857a0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.730440:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043873664 00000100:00100000:2.0:1788587723.730446:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043873664 00000100:00100000:2.0:1788587723.730482:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788587723.730492:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:8529:x1875470043873664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587723.731474:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:8529:x1875470043873664:12345-0@lo:502:llog_process_th.0 Request processed in 982us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587723.731482:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788587723.731759:0:8529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8529:1875470043873664:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788587723.731791:0:8529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788587723.732692:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788587723.732712:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788587723.732722:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.732733:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587723.732742:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788587723.732744:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788587723.732747:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788587723.732775:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.732783:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.732798:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587723.732816:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043873792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.733585:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587723.733656:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4918de6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.733703:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043873792 00000100:00100000:3.0:1788587723.733709:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043873792 00000100:00100000:3.0:1788587723.734189:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788587723.734200:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043873792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587723.734213:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587723.734233:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4baed5a00/0xa13e120d54ca830b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8304 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.734257:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed5a00/0xa13e120d54ca830b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8304 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.734267:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4baed5a00/0xa13e120d54ca830b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8304 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.734275:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed5a00, rc 0) 00000100:00100000:3.0:1788587723.734322:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043873792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.734330:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788587723.734647:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043873792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587723.734662:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.734671:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587723.734731:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043873920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.734760:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.734782:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488b99c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.734794:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043873920 00000100:00100000:3.0:1788587723.734798:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043873920 00000100:00100000:3.0:1788587723.734819:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788587723.734826:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043873920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.735041:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043873920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.735052:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788587723.735098:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043873920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.735123:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043874048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.735155:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.735181:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488b99c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.735192:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043874048 00000100:00100000:3.0:1788587723.735196:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043874048 00000100:00100000:3.0:1788587723.735216:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788587723.735222:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043874048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.735347:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043874048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.735353:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788587723.735554:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043874048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587723.738500:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8532:1875470043874176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.738569:0:8532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.738604:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043874176 00000100:00100000:3.0:1788587723.738610:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043874176 00000100:00100000:3.0:1788587723.738642:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788587723.738650:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:8532:x1875470043874176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.740191:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:8532:x1875470043874176:12345-0@lo:502:llog_process_th.0 Request processed in 1536us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.740202:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788587723.740333:0:8532:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4afd7a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.740354:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8532:1875470043874176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587723.740383:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587723.740402:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587723.740404:0:8532:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788587723.740410:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788587723.740440:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8532:1875470043874304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587723.740479:0:8532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587723.740497:0:8532:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4918de600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.741318:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043874304 00000100:00100000:3.0:1788587723.741325:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043874304 00000100:00100000:3.0:1788587723.741366:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788587723.741375:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:8532:x1875470043874304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.741569:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:8532:x1875470043874304:12345-0@lo:502:llog_process_th.0 Request processed in 195us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.741577:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788587723.742015:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8532:1875470043874304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587723.742044:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587723.742050:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587723.742052:0:8532:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788587723.742113:0:8532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788587723.742278:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788587723.742300:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788587723.742310:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.742320:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587723.742329:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587723.742332:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f488106000 from 4 10000000:01000000:1.0:1788587723.742335:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587723.742362:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.742369:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.742378:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587723.742461:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043874432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.742495:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587723.742554:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491ee76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.742586:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043874432 00000100:00100000:2.0:1788587723.742590:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043874432 00000100:00100000:2.0:1788587723.742648:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788587723.742656:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043874432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587723.742673:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587723.742697:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca8319 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8312 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.742722:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca8319 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8312 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.742732:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca8319 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8312 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.742740:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d800, rc 0) 00000100:00100000:2.0:1788587723.742772:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043874432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587723.742778:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788587723.742895:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043874432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587723.742907:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8319 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.742916:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca8319 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587723.743045:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043874560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.743188:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587723.743249:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491ee76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.743281:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043874560 00000100:00100000:2.0:1788587723.743286:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043874560 00000100:00100000:2.0:1788587723.743316:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788587723.743322:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043874560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.743617:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043874560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587723.743624:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788587723.743746:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043874560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.743776:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043874688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.743812:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587723.743907:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491ee76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.744008:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043874688 00000100:00100000:2.0:1788587723.744013:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043874688 00000100:00100000:2.0:1788587723.744072:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788587723.744078:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043874688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.744214:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043874688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587723.744221:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788587723.744321:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043874688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587723.745545:0:8533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8533:1875470043874816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587723.745602:0:8533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587723.745635:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043874816 00000100:00100000:2.0:1788587723.745639:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043874816 00000100:00100000:2.0:1788587723.745674:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788587723.745682:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:8533:x1875470043874816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587723.746019:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:8533:x1875470043874816:12345-0@lo:502:llog_process_th.0 Request processed in 337us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587723.746026:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788587723.746065:0:8533:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4918de240 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.746088:0:8533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8533:1875470043874816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587723.746112:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587723.746273:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587723.746276:0:8533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788587723.746285:0:8533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88f488106000 00000020:00000080:2.0:1788587723.746287:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788587723.749345:0:8533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c94a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8533:1875470043874944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587723.750064:0:8533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587723.750100:0:8533:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486647600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587723.750392:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043874944 00000100:00100000:2.0:1788587723.750401:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043874944 00000100:00100000:2.0:1788587723.750456:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788587723.750465:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:8533:x1875470043874944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587723.750652:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:8533:x1875470043874944:12345-0@lo:502:llog_process_th.0 Request processed in 188us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587723.750659:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788587723.750757:0:8533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c94a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:8533:1875470043874944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587723.750784:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587723.750791:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587723.750794:0:8533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788587723.750799:0:8533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788587723.757331:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788587723.757359:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587723.757369:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8319 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.757381:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8319 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587723.757470:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788587723.757472:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88f48709cd40 from 1 10000000:01000000:1.0:1788587723.757475:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788587723.757510:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481668800/0xa13e120d54ca8320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.757518:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481668800/0xa13e120d54ca8320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.757528:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481668800/0xa13e120d54ca8320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587723.757557:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043875072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.757614:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587723.757657:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f487e38900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587723.757809:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043875072 00000100:00100000:3.0:1788587723.757816:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043875072 00000100:00100000:3.0:1788587723.757882:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788587723.757890:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043875072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587723.757903:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587723.757914:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4baed5e00/0xa13e120d54ca8327 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8320 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.758243:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed5e00/0xa13e120d54ca8327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8320 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.758256:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4baed5e00/0xa13e120d54ca8327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8320 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587723.758265:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed5e00, rc 0) 00000100:00100000:3.0:1788587723.758308:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043875072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 418us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587723.758315:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788587723.758730:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043875072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587723.758746:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481668800/0xa13e120d54ca8320 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8327 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587723.758757:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481668800/0xa13e120d54ca8320 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca8327 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587723.758812:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043875200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.758875:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587723.758898:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f487e38900 going to sleep for 11 seconds 00000100:00100000:1.0:1788587723.758911:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043875200 00000100:00100000:1.0:1788587723.758915:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043875200 00000100:00100000:1.0:1788587723.758940:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788587723.758958:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043875200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587723.759232:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043875200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (389us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587723.759239:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788587723.760324:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043875200:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788587723.763242:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788587723.763259:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481668800/0xa13e120d54ca8320 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8327 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587723.763290:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481668800/0xa13e120d54ca8320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8327 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587724.232372:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587724.317716:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587724.317811:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026020096 00000100:00100000:2.0:1788587724.317820:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026020096 00000100:00100000:2.0:1788587724.317893:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 184 00000100:00100000:2.0:1788587724.317903:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:5587:x1875470026020096:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587724.317920:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587724.317937:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca832e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db106e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587724.317965:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca832e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db106e expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587724.317977:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca832e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db106e expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587724.317986:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d000, rc 0) 00000100:00100000:2.0:1788587724.318044:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5587:x1875470026020096:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 Request processed in 143us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587724.318052:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 184 00000100:00100000:3.0:1788587724.323963:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587724.324317:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026020224 00000100:00100000:3.0:1788587724.324326:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026020224 00000100:00100000:3.0:1788587724.324367:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 185 00000100:00100000:3.0:1788587724.324376:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5587:x1875470026020224:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587724.324607:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5587:x1875470026020224:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 Request processed in 232us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587724.324615:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 185 00000100:00100000:3.0:1788587724.334834:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587724.337542:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026020352 00000100:00100000:0.0:1788587724.337556:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026020352 00000100:00100000:0.0:1788587724.337617:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 186 00000100:00100000:0.0:1788587724.337626:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5587:x1875470026020352:12345-192.168.206.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587724.337865:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:5587:x1875470026020352:12345-192.168.206.33@tcp:503:ll_cfg_requeue.0 Request processed in 239us (3037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587724.337872:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 186 00000100:00100000:3.0:1788587724.342571:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587724.343508:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026020480 00000100:00100000:0.0:1788587724.343518:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026020480 00000100:00100000:3.0:1788587724.343632:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 187 00000100:00100000:3.0:1788587724.343642:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:6105:x1875470026020480:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788587724.343887:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:6105:x1875470026020480:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 245us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587724.343895:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 187 00000100:00100000:0.0:1788587724.346263:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587724.346380:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026020608 00000100:00100000:3.0:1788587724.346388:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026020608 00000100:00100000:3.0:1788587724.346433:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 188 00000100:00100000:3.0:1788587724.346442:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:6105:x1875470026020608:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788587724.346660:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:6105:x1875470026020608:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 218us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587724.346678:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 188 00000100:00100000:1.0:1788587724.766477:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587724.766576:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026020864 00000100:00100000:3.0:1788587724.766585:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026020864 00000100:00100000:3.0:1788587724.767102:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:3.0:1788587724.767116:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2347:x1875470026020864:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587724.767203:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2347:x1875470026020864:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 91us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587724.767212:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00080000:0.0:1788587724.767279:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587724.767889:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587724.767938:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587724.767973:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026020736 00000100:00100000:0.0:1788587724.767980:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026020736 00000100:00100000:0.0:1788587724.768040:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 25 00000100:00100000:0.0:1788587724.768048:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026020736:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587724.768101:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026020736:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 54us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587724.768107:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 25 00000100:00080000:1.0:1788587724.768186:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587724.768423:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026020992 00000100:00100000:2.0:1788587724.768429:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026020992 00000100:00100000:2.0:1788587724.768478:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:2.0:1788587724.768487:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2346:x1875470026020992:12345-192.168.206.33@tcp:400:kworker.0 00000100:00080000:1.0:1788587724.768503:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587724.768553:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2346:x1875470026020992:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 67us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587724.768561:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 11 00010000:00010000:3.0:1788587725.266637:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587726.280989:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587726.792919:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587726.792949:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043875328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587726.793266:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587726.793759:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043875328 00000100:00100000:0.0:1788587726.793770:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043875328 00000100:00100000:0.0:1788587726.793994:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788587726.794006:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043875328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587726.794050:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587726.794120:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043875328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587726.794127:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788587726.794187:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6fb480 x1875470043875328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587726.794226:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043875328:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788587726.796596:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788587727.308808:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587727.816130:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043875456:0@lo:400:kworker.0 00000100:00100000:2.0:1788587727.816208:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587727.816251:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875470043875968:0@lo:400:kworker.0 00000100:00100000:2.0:1788587727.816277:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587727.816301:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788587727.816307:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043875584:0@lo:400:kworker.0 00000100:00100000:2.0:1788587727.816584:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587727.816608:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043876096:0@lo:400:kworker.0 00000100:00100000:2.0:1788587727.817423:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587727.817465:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043875712:0@lo:400:kworker.0 00000100:00100000:2.0:1788587727.817492:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587727.817512:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587727.817591:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043875840:0@lo:400:kworker.0 00000100:00100000:2.0:1788587727.817626:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587727.818967:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043875968 00000100:00100000:1.0:1788587727.818979:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043875968 00000100:00100000:1.0:1788587727.819037:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043875584 00000100:00100000:1.0:1788587727.819041:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043875584 00000100:00100000:1.0:1788587727.819059:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043875712 00000100:00100000:1.0:1788587727.819061:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043875712 00000100:00100000:1.0:1788587727.819076:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788587727.819085:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875470043875968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587727.819160:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875470043875968:12345-0@lo:400:kworker.0 Request processed in 65us (2870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587727.819167:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788587727.819184:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788587727.819190:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043875584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587727.819217:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043875584:12345-0@lo:400:kworker.0 Request processed in 27us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587727.819223:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788587727.819232:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788587727.819238:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043875712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587727.819263:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043875712:12345-0@lo:400:kworker.0 Request processed in 26us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587727.819269:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788587727.819284:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587727.819361:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043875456 00000100:00100000:2.0:1788587727.819365:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043875456 00000100:00100000:2.0:1788587727.819394:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788587727.819400:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3304:x1875470043875456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587727.819437:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3304:x1875470043875456:12345-0@lo:400:kworker.0 Request processed in 37us (3229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587727.819453:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788587727.819488:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043876096 00000100:00100000:2.0:1788587727.819492:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043876096 00000100:00100000:2.0:1788587727.819532:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043875840 00000100:00100000:2.0:1788587727.819535:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043875840 00000100:00100000:2.0:1788587727.819551:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587727.819557:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043876096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587727.819591:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043876096:12345-0@lo:400:kworker.0 Request processed in 34us (2169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587727.819597:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587727.819607:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587727.819613:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043875840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587727.819636:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043875840:12345-0@lo:400:kworker.0 Request processed in 23us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587727.819641:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587727.821057:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043875584:0@lo:400:kworker.0 00010000:00080000:1.0:1788587727.821077:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4baa90000 x1875470043876096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587727.821089:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043876096:0@lo:400:kworker.0 00000100:00100000:1.0:1788587727.821100:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043875456:0@lo:400:kworker.0 00000100:00100000:1.0:1788587727.821122:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875470043875968:0@lo:400:kworker.0 00000100:00080000:1.0:1788587727.821165:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587727.821271:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587727.821284:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043876224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587727.821331:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587727.821496:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043876224 00000100:00100000:1.0:1788587727.821503:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043876224 00000100:00100000:1.0:1788587727.821542:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788587727.821550:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043876224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587727.821581:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587727.821623:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043876224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587727.821630:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788587727.821664:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b53ac700 x1875470043876224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587727.821678:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043876224:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788587727.823028:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4baa91180 x1875470043875840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587727.823042:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043875840:0@lo:400:kworker.0 00000100:00100000:2.0:1788587727.823249:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043875712:0@lo:400:kworker.0 00010000:00010000:2.0:1788587728.328474:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788587728.929401:0:8815:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg633-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788587729.355828:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587729.888672:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587729.889035:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026021120 00000100:00100000:0.0:1788587729.889052:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026021120 00000100:00100000:0.0:1788587729.889150:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 190 00000100:00100000:3.0:1788587729.889154:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587729.889203:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587729.889245:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587729.889255:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026021248 00000100:00100000:2.0:1788587729.889263:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026021248 00000100:00100000:0.0:1788587729.889274:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2345:x1875470026021120:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587729.889290:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026021376 00000100:00100000:3.0:1788587729.889300:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026021376 00000100:00100000:2.0:1788587729.889327:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 29 00000100:00100000:2.0:1788587729.889342:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2345:x1875470026021248:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587729.889368:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026021504 00000100:00100000:0.0:1788587729.889370:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2345:x1875470026021120:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 205us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587729.889374:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026021504 00000100:00100000:0.0:1788587729.889386:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 190 00000100:00100000:2.0:1788587729.889460:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2345:x1875470026021248:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 120us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587729.889468:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 29 00000100:00080000:2.0:1788587729.889491:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587729.889495:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587729.889498:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587729.889541:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 14 00000100:00100000:3.0:1788587729.889560:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026021376:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587729.889710:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026021376:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 155us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587729.889720:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 14 00000100:00100000:3.0:1788587729.890134:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 15 00000100:00100000:3.0:1788587729.890167:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026021504:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587729.890207:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026021504:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 41us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587729.890214:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 15 00010000:00010000:2.0:1788587730.376034:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587731.405905:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587731.914420:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043876352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587731.914486:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587731.914707:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043876352 00000100:00100000:0.0:1788587731.914716:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043876352 00000100:00100000:0.0:1788587731.914775:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788587731.914803:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587731.914829:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043876352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587731.914883:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587731.914933:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043876352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (447us total) trans 0 rc 0/0 00010000:00080000:2.0:1788587731.915005:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6fb100 x1875470043876352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587731.915023:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043876352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587731.915514:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788587732.426865:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587732.936033:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043876480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587732.936100:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587732.936185:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043876480 00000100:00100000:1.0:1788587732.936194:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043876480 00000100:00100000:1.0:1788587732.936248:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788587732.936256:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043876480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587732.936292:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587732.936330:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043876480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587732.936337:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788587732.936388:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b53ac700 x1875470043876480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587732.936405:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043876480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587732.936670:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043876608:0@lo:400:kworker.0 00000100:00100000:2.0:1788587732.936706:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587732.936730:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043877120:0@lo:400:kworker.0 00000100:00100000:2.0:1788587732.936752:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587732.936771:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587732.936776:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043876992:0@lo:400:kworker.0 00000100:00100000:2.0:1788587732.936796:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788587732.936817:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587732.936826:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043876736:0@lo:400:kworker.0 00000100:00100000:2.0:1788587732.936864:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587732.936881:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587732.936886:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043876864:0@lo:400:kworker.0 00000100:00100000:2.0:1788587732.936916:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587732.936943:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043876608 00000100:00100000:2.0:1788587732.936947:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043876608 00000100:00100000:2.0:1788587732.936975:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788587732.936982:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043876608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587732.937015:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043876608:12345-0@lo:400:kworker.0 Request processed in 34us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587732.937021:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788587732.937048:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043877120 00000100:00100000:2.0:1788587732.937052:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043877120 00000100:00100000:2.0:1788587732.937077:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043876736 00000100:00100000:2.0:1788587732.937082:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043876736 00000100:00100000:2.0:1788587732.937098:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043876864 00000100:00100000:2.0:1788587732.937101:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043876864 00000100:00100000:2.0:1788587732.937117:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788587732.937136:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043877120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587732.937165:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043877120:12345-0@lo:400:kworker.0 Request processed in 31us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587732.937172:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788587732.937184:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788587732.937190:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043876736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587732.937220:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043876736:12345-0@lo:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587732.937225:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788587732.937234:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788587732.937239:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043876864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587732.937265:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043876864:12345-0@lo:400:kworker.0 Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587732.937277:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788587732.937298:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043876992 00000100:00100000:2.0:1788587732.937302:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043876992 00000100:00100000:2.0:1788587732.937326:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788587732.937332:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043876992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587732.937359:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043876992:12345-0@lo:400:kworker.0 Request processed in 27us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587732.937364:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788587732.937390:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587732.937406:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043876864:0@lo:400:kworker.0 00000100:00100000:2.0:1788587732.937415:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043876736:0@lo:400:kworker.0 00010000:00080000:2.0:1788587732.937434:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4baa91500 x1875470043876992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587732.937444:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043876992:0@lo:400:kworker.0 00000100:00100000:2.0:1788587732.937451:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043876608:0@lo:400:kworker.0 00000100:00100000:2.0:1788587732.937458:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043877120:0@lo:400:kworker.0 00000001:02000400:1.0:1788587733.426294:0:9058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg633-server.virtnet: executing yml_node 00010000:00010000:3.0:1788587733.449102:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587734.477747:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587735.019825:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587735.019899:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587735.019934:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587735.019966:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587735.020025:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026021632 00000100:00100000:0.0:1788587735.020035:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026021632 00000100:00100000:0.0:1788587735.020093:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 192 00000100:00100000:0.0:1788587735.020103:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485ca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2345:x1875470026021632:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587735.020176:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026021760 00000100:00100000:2.0:1788587735.020181:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026021760 00000100:00100000:0.0:1788587735.020183:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485ca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2345:x1875470026021632:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587735.020203:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 192 00000100:00100000:2.0:1788587735.020219:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 33 00000100:00100000:2.0:1788587735.020225:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2344:x1875470026021760:12345-192.168.206.33@tcp:400:kworker.0 00000100:00080000:0.0:1788587735.020245:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587735.020256:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2344:x1875470026021760:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 31us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587735.020256:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026021888 00000100:00100000:0.0:1788587735.020259:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026021888 00000100:00100000:2.0:1788587735.020262:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 33 00000100:00100000:0.0:1788587735.020285:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026022016 00000100:00100000:0.0:1788587735.020288:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026022016 00000100:00080000:1.0:1788587735.020543:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587735.020546:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587735.020619:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 17 00000100:00100000:2.0:1788587735.020632:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026021888:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587735.020677:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026021888:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 48us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587735.027681:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587735.027696:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788587735.029010:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 18 00000100:00100000:1.0:1788587735.029225:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2344:x1875470026022016:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587735.029325:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2344:x1875470026022016:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 304us (9357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587735.029333:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 18 00000100:00100000:2.0:1788587735.034992:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 17 00010000:00010000:3.0:1788587735.496044:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587736.520429:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587737.032239:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587737.032259:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043877248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587737.032324:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587737.034075:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043877248 00000100:00100000:1.0:1788587737.034086:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043877248 00000100:00100000:1.0:1788587737.034247:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788587737.034257:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043877248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587737.034290:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587737.034365:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043877248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (2041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587737.034372:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788587737.036927:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6f8700 x1875470043877248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587737.036954:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043877248:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788587737.039355:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788587737.544209:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788587737.707923:0:9251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00000100:00100000:1.0:1788587738.057267:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043877632:0@lo:400:kworker.0 00000100:00100000:1.0:1788587738.057335:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587738.057387:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788587738.057394:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043877504:0@lo:400:kworker.0 00000100:00100000:1.0:1788587738.057430:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587738.057449:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043878016:0@lo:400:kworker.0 00000100:00100000:1.0:1788587738.057471:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587738.057505:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043877632 00000100:00100000:1.0:1788587738.057512:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043877632 00000100:00100000:1.0:1788587738.057556:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043877504 00000100:00100000:1.0:1788587738.057559:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043877504 00000100:00100000:1.0:1788587738.057577:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788587738.057585:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043877632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587738.057792:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043877376:0@lo:400:kworker.0 00000100:00100000:2.0:1788587738.057828:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587738.057876:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875470043877888:0@lo:400:kworker.0 00000100:00100000:2.0:1788587738.057905:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587738.057923:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587738.057928:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043877760:0@lo:400:kworker.0 00000100:00100000:2.0:1788587738.057958:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587738.057983:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587738.057990:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043878144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587738.058014:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587738.058040:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043877376 00000100:00100000:2.0:1788587738.058043:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043877376 00000100:00100000:2.0:1788587738.058069:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788587738.058076:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3303:x1875470043877376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587738.058131:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3303:x1875470043877376:12345-0@lo:400:kworker.0 Request processed in 55us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587738.058138:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788587738.058167:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043877888 00000100:00100000:2.0:1788587738.058172:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043877888 00000100:00100000:2.0:1788587738.058188:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788587738.058194:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043877504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587738.058235:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043877504:12345-0@lo:400:kworker.0 Request processed in 40us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587738.058242:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788587738.058256:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587738.058263:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875470043877888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587738.058288:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875470043877888:12345-0@lo:400:kworker.0 Request processed in 26us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587738.058294:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587738.058312:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043878016 00000100:00100000:2.0:1788587738.058315:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043878016 00000100:00100000:2.0:1788587738.058339:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043877760 00000100:00100000:2.0:1788587738.058342:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043877760 00000100:00100000:2.0:1788587738.058359:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788587738.058365:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043878016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587738.058394:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043878016:12345-0@lo:400:kworker.0 Request processed in 29us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587738.058399:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788587738.058409:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788587738.058414:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043877760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587738.058435:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043877760:12345-0@lo:400:kworker.0 Request processed in 22us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587738.058441:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788587738.058457:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043878144 00000100:00100000:2.0:1788587738.058460:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043878144 00000100:00100000:2.0:1788587738.058480:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788587738.058485:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043878144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587738.058518:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587738.058549:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043878144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587738.058555:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788587738.058603:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6f8a80 x1875470043878144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587738.058621:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043878144:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788587738.058650:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b53af800 x1875470043877760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587738.058660:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043877760:0@lo:400:kworker.0 00000100:00100000:2.0:1788587738.058669:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043877376:0@lo:400:kworker.0 00000100:00100000:2.0:1788587738.058679:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875470043877888:0@lo:400:kworker.0 00000100:00100000:1.0:1788587738.060924:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043877632:12345-0@lo:400:kworker.0 Request processed in 3335us (3585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587738.060936:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788587738.060985:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587738.060990:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587738.061032:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043877504:0@lo:400:kworker.0 00010000:00080000:1.0:1788587738.061047:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b53ad880 x1875470043878016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587738.061058:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043878016:0@lo:400:kworker.0 00000100:00100000:1.0:1788587738.061068:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043877632:0@lo:400:kworker.0 00010000:00010000:3.0:1788587738.570221:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587739.595172:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788587739.798528:0:9348:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00000100:00100000:1.0:1788587740.130728:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587740.130784:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587740.130875:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026022272 00000100:00100000:3.0:1788587740.130885:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026022272 00000100:00100000:3.0:1788587740.130944:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 37 00000100:00100000:3.0:1788587740.130954:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2345:x1875470026022272:12345-192.168.206.33@tcp:400:kworker.0 00000100:00080000:1.0:1788587740.130958:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587740.131027:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2345:x1875470026022272:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587740.131035:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 37 00000100:00100000:0.0:1788587740.131177:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026022144 00000100:00100000:0.0:1788587740.131182:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026022144 00000100:00100000:0.0:1788587740.131220:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 194 00000100:00100000:0.0:1788587740.131227:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2345:x1875470026022144:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587740.131276:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2345:x1875470026022144:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 49us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587740.131284:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 194 00000100:00100000:1.0:1788587740.138834:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587740.138974:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587740.139231:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026022400 00000100:00100000:2.0:1788587740.139240:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026022400 00000100:00100000:2.0:1788587740.139301:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026022528 00000100:00100000:2.0:1788587740.139305:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026022528 00000100:00100000:2.0:1788587740.139329:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:2.0:1788587740.139338:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2343:x1875470026022400:12345-192.168.206.33@tcp:9:kworker.0 00000020:00000080:2.0:1788587740.139371:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca826a 00000100:00080000:2.0:1788587740.139381:0:6694:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb09000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587740.139414:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788587740.139736:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+2:2343:x1875470026022400:12345-192.168.206.33@tcp:9:kworker.0 Request processed in 397us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587740.139744:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:2.0:1788587740.139773:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:2.0:1788587740.139780:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2343:x1875470026022528:12345-192.168.206.33@tcp:9:kworker.0 00000020:00000080:2.0:1788587740.139793:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8271 00000100:00080000:2.0:1788587740.139799:0:6694:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb44800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587740.139819:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788587740.140043:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+2:2343:x1875470026022528:12345-192.168.206.33@tcp:9:kworker.0 Request processed in 262us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587740.140050:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 11 00010000:00010000:2.0:1788587740.140074:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587740.140186:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587740.140296:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587740.140301:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788587740.618588:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587741.639914:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587742.152083:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587742.152104:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043878272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587742.152160:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587742.152265:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043878272 00000100:00100000:0.0:1788587742.152272:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043878272 00000100:00100000:0.0:1788587742.152354:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788587742.152363:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043878272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587742.152393:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587742.152439:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043878272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587742.152446:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788587742.152479:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6faa00 x1875470043878272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587742.152507:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043878272:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788587742.153813:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788587742.174825:0:9446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:0.0:1788587742.664106:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788587742.732956:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000020:00000080:0.0:1788587742.732964:0:6718:0:(genops.c:885:class_export_put()) final put ffff88f4bfb08800/5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000020:00000080:1.0:1788587742.733247:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bfb08800/5bcb85a0-1673-40ab-a41b-fd8baee9796e for lustre-OST0000 00000020:00000080:1.0:1788587742.733296:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4bfb09000 for lustre-OST0000 00000100:00100000:2.0:1788587743.179408:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587743.180800:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043878528:0@lo:400:kworker.0 00000100:00100000:0.0:1788587743.180882:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587743.181003:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587743.181011:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043878656:0@lo:400:kworker.0 00000100:00100000:1.0:1788587743.181044:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587743.181094:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043878528 00000100:00100000:1.0:1788587743.181101:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043878528 00000100:00100000:1.0:1788587743.181138:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788587743.181147:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3304:x1875470043878528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587743.181193:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3304:x1875470043878528:12345-0@lo:400:kworker.0 Request processed in 46us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587743.181200:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788587743.181245:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043878528:0@lo:400:kworker.0 00000100:00100000:0.0:1788587743.181802:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043878656 00000100:00100000:0.0:1788587743.181809:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043878656 00000100:00100000:0.0:1788587743.181871:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788587743.181879:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043878656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587743.181927:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043878656:12345-0@lo:400:kworker.0 Request processed in 49us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587743.181939:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788587743.181975:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043878656:0@lo:400:kworker.0 00000100:00100000:1.0:1788587743.182687:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043878784:0@lo:400:kworker.0 00000100:00100000:1.0:1788587743.182730:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587743.182765:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043878400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587743.182790:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587743.182883:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043878400 00000100:00100000:0.0:1788587743.182888:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043878400 00000100:00100000:0.0:1788587743.182937:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587743.182944:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043878400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587743.182978:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587743.183020:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043878400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587743.183026:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788587743.183061:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6faa00 x1875470043878400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587743.183107:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043878400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587743.183179:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043878784 00000100:00100000:2.0:1788587743.183184:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043878784 00000100:00100000:2.0:1788587743.183222:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788587743.183230:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043878784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587743.183268:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043878784:12345-0@lo:400:kworker.0 Request processed in 39us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587743.183274:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1788587743.183332:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587743.183338:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587743.183388:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043878784:0@lo:400:kworker.0 00000100:00100000:3.0:1788587743.188786:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587743.188807:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043879040:0@lo:400:kworker.0 00000100:00100000:3.0:1788587743.188890:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587743.188932:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043879040 00000100:00100000:3.0:1788587743.188938:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043879040 00000100:00100000:3.0:1788587743.188992:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788587743.189001:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043879040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587743.189049:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043879040:12345-0@lo:400:kworker.0 Request processed in 49us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587743.189056:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788587743.189106:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043879040:0@lo:400:kworker.0 00000100:00080000:3.0:1788587743.189129:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587743.189153:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043878912:0@lo:400:kworker.0 00000100:00100000:1.0:1788587743.189186:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587743.189656:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043878912 00000100:00100000:3.0:1788587743.189662:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043878912 00000100:00100000:3.0:1788587743.189702:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788587743.189710:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043878912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587743.189760:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043878912:12345-0@lo:400:kworker.0 Request processed in 51us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587743.189767:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788587743.189873:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b4c94e00 x1875470043878912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587743.189885:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043878912:0@lo:400:kworker.0 00010000:00010000:2.0:1788587743.690077:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587743.783416:0:9495:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 01:55:41 EDT 2026 00010000:00010000:0.0:1788587744.712169:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788587744.740509:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000020:00000080:0.0:1788587744.740516:0:7648:0:(genops.c:885:class_export_put()) final put ffff88f4bfb0e800/5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000020:00000080:3.0:1788587744.740562:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bfb0e800/5bcb85a0-1673-40ab-a41b-fd8baee9796e for lustre-OST0001 00000020:00000080:3.0:1788587744.744312:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4bfb44800 for lustre-OST0001 00000100:00100000:1.0:1788587745.246135:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587745.246213:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026022784 00000100:00100000:2.0:1788587745.246222:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026022784 00000100:00100000:2.0:1788587745.246287:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 41 00000100:00100000:2.0:1788587745.246297:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2344:x1875470026022784:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587745.246363:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2344:x1875470026022784:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 67us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587745.246380:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 41 00000100:00080000:1.0:1788587745.246619:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587745.250265:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587745.250298:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026022656 00000100:00100000:0.0:1788587745.250306:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026022656 00000100:00100000:0.0:1788587745.250503:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 196 00000100:00100000:0.0:1788587745.250513:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2345:x1875470026022656:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587745.250584:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2345:x1875470026022656:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 71us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587745.250591:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 196 00010000:00010000:2.0:1788587745.736187:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587746.762700:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587747.277978:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587747.277999:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043879168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587747.278072:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587747.278231:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043879168 00000100:00100000:0.0:1788587747.278239:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043879168 00000100:00100000:0.0:1788587747.278302:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788587747.278312:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043879168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587747.278341:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587747.278386:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043879168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587747.278392:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788587747.278426:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6faa00 x1875470043879168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587747.278441:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043879168:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788587747.278553:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788587747.784267:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587748.296056:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043879296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587748.296121:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587748.296235:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043879296 00000100:00100000:0.0:1788587748.296243:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043879296 00000100:00080000:1.0:1788587748.296543:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587748.296763:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587748.296775:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043879296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587748.296809:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587748.296891:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043879296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587748.296898:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788587748.296978:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043879424:0@lo:400:kworker.0 00000100:00100000:1.0:1788587748.297014:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587748.297052:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875470043879936:0@lo:400:kworker.0 00000100:00100000:1.0:1788587748.297078:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587748.297100:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587748.297106:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043879808:0@lo:400:kworker.0 00000100:00100000:1.0:1788587748.297130:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587748.297158:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043879552:0@lo:400:kworker.0 00000100:00100000:1.0:1788587748.297182:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587748.297203:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587748.297209:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043879680:0@lo:400:kworker.0 00000100:00100000:1.0:1788587748.297231:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587748.297263:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043879424 00000100:00100000:1.0:1788587748.297267:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043879424 00000100:00100000:1.0:1788587748.297779:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788587748.297789:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3303:x1875470043879424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587748.297860:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3303:x1875470043879424:12345-0@lo:400:kworker.0 Request processed in 54us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587748.297873:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788587748.297903:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043879936 00000100:00100000:1.0:1788587748.297907:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043879936 00000100:00100000:1.0:1788587748.297943:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043879552 00000100:00100000:1.0:1788587748.297947:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043879552 00000100:00100000:1.0:1788587748.297968:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043879680 00000100:00100000:1.0:1788587748.297971:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043879680 00000100:00100000:3.0:1788587748.297976:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043879424:0@lo:400:kworker.0 00000100:00100000:1.0:1788587748.297992:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788587748.298001:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875470043879936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587748.298058:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875470043879936:12345-0@lo:400:kworker.0 Request processed in 59us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587748.298064:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788587748.298076:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788587748.298082:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043879552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587748.298113:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043879552:12345-0@lo:400:kworker.0 Request processed in 32us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587748.298119:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788587748.298130:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788587748.298137:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043879680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587748.298165:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875470043879936:0@lo:400:kworker.0 00000100:00100000:1.0:1788587748.298171:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043879680:12345-0@lo:400:kworker.0 Request processed in 35us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587748.298184:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788587748.298207:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043879808 00000100:00100000:1.0:1788587748.298211:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043879808 00000100:00100000:1.0:1788587748.298244:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587748.298251:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043879808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587748.298375:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043879808:12345-0@lo:400:kworker.0 Request processed in 43us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587748.298382:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788587748.298417:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587748.298438:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043879680:0@lo:400:kworker.0 00000100:00100000:1.0:1788587748.298452:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043879552:0@lo:400:kworker.0 00010000:00080000:3.0:1788587748.298472:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf76f480 x1875470043879808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587748.298486:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043879808:0@lo:400:kworker.0 00010000:00080000:1.0:1788587748.298488:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6faa00 x1875470043879296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587748.298506:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043879296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788587748.809203:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587749.845490:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587750.366613:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587750.370650:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587750.370691:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026022912 00000100:00100000:1.0:1788587750.370701:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026022912 00000100:00100000:1.0:1788587750.370757:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 198 00000100:00100000:1.0:1788587750.370769:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2347:x1875470026022912:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587750.370863:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2347:x1875470026022912:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 97us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587750.370871:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 198 00000100:00100000:2.0:1788587750.378136:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026023040 00000100:00100000:2.0:1788587750.378149:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026023040 00000100:00100000:2.0:1788587750.378225:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 45 00000100:00100000:2.0:1788587750.378234:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026023040:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587750.378303:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026023040:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 70us (11699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587750.378311:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 45 00000100:00080000:0.0:1788587750.378563:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587750.857721:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587751.886715:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587752.395207:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043880064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587752.395276:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587752.395354:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043880064 00000100:00100000:1.0:1788587752.395361:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043880064 00000100:00100000:1.0:1788587752.395410:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788587752.395420:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043880064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587752.395460:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587752.395503:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043880064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587752.395510:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788587752.395530:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788587752.395558:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6fbb80 x1875470043880064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587752.395577:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043880064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788587752.906938:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587753.416135:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043880320:0@lo:400:kworker.0 00000100:00100000:0.0:1788587753.416216:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587753.416244:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043880320 00000100:00100000:1.0:1788587753.416251:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043880320 00000100:00100000:1.0:1788587753.416298:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587753.416307:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043880320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587753.416424:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043880192:0@lo:400:kworker.0 00000100:00100000:3.0:1788587753.416503:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043880576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587753.416993:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043880832:0@lo:400:kworker.0 00000100:00100000:1.0:1788587753.417475:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043880320:12345-0@lo:400:kworker.0 Request processed in 1167us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587753.417484:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788587753.421775:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587753.421833:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043880704:0@lo:400:kworker.0 00000100:00100000:1.0:1788587753.421879:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043880192 00000100:00100000:2.0:1788587753.421889:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587753.421889:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043880192 00000100:00100000:1.0:1788587753.421943:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788587753.421950:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043880448:0@lo:400:kworker.0 00000100:00100000:1.0:1788587753.421956:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043880192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587753.421995:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587753.422032:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043880960:0@lo:400:kworker.0 00000100:00100000:1.0:1788587753.422040:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043880192:12345-0@lo:400:kworker.0 Request processed in 87us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587753.422049:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788587753.422060:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587753.422093:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043880448 00000100:00100000:1.0:1788587753.422097:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043880448 00000100:00100000:2.0:1788587753.422101:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043880704 00000100:00100000:2.0:1788587753.422107:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043880704 00000100:00100000:1.0:1788587753.422157:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788587753.422164:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043880448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587753.424998:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587753.425893:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587753.425967:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043880960 00000100:00100000:0.0:1788587753.426140:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043880320:0@lo:400:kworker.0 00000100:00080000:0.0:1788587753.426357:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587753.426385:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043880192:0@lo:400:kworker.0 00000100:00100000:0.0:1788587753.426412:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043880832 00000100:00100000:0.0:1788587753.426418:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043880832 00000100:00100000:0.0:1788587753.426463:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788587753.426471:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043880832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587753.426593:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043880832:12345-0@lo:400:kworker.0 Request processed in 122us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587753.426601:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788587753.426632:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587753.426649:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043880832:0@lo:400:kworker.0 00000100:00100000:2.0:1788587753.426736:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043880960 00000100:00100000:2.0:1788587753.426777:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587753.426784:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043880704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587753.426824:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043880704:12345-0@lo:400:kworker.0 Request processed in 40us (4935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587753.426839:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587753.426872:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587753.426878:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043880960:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788587753.426994:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788587753.427025:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf76c380 x1875470043880704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587753.427036:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043880704:0@lo:400:kworker.0 00000100:00100000:1.0:1788587753.431177:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043880448:12345-0@lo:400:kworker.0 Request processed in 9005us (9173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587753.431190:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788587753.431492:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043880960:12345-0@lo:400:kworker.0 Request processed in 4611us (9430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587753.431502:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788587753.434598:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043880448:0@lo:400:kworker.0 00010000:00080000:1.0:1788587753.434629:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf76dc00 x1875470043880960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587753.434641:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043880960:0@lo:400:kworker.0 00000100:00100000:1.0:1788587753.436633:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043880576 00000100:00100000:1.0:1788587753.436646:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043880576 00000100:00100000:1.0:1788587753.436708:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788587753.436718:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043880576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587753.436753:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587753.436830:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043880576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (11839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587753.436838:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788587753.437416:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6fbb80 x1875470043880576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587753.437436:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043880576:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788587753.933326:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587754.955142:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587755.494628:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587755.494669:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587755.494754:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026023296 00000100:00100000:2.0:1788587755.494762:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026023296 00000100:00100000:3.0:1788587755.494901:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026023168 00000100:00100000:3.0:1788587755.494905:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026023168 00000100:00100000:3.0:1788587755.494937:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 200 00000100:00100000:3.0:1788587755.494946:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2347:x1875470026023168:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587755.495022:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2347:x1875470026023168:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 76us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587755.495030:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 200 00000100:00100000:2.0:1788587755.495788:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 49 00000100:00100000:2.0:1788587755.495800:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2347:x1875470026023296:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587755.497329:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2347:x1875470026023296:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 1525us (2652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587755.497341:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 49 00000100:00080000:2.0:1788587755.497381:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788587755.982379:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587757.001398:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587757.512191:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587757.512216:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043881088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587757.512281:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587757.512521:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043881088 00000100:00100000:0.0:1788587757.512529:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043881088 00000100:00100000:0.0:1788587757.512591:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587757.512600:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043881088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587757.512633:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587757.512693:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043881088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587757.512700:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788587757.512806:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788587757.512911:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6f8700 x1875470043881088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587757.512930:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043881088:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788587758.025233:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587758.536128:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043881216:0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.536195:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587758.536252:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043881728:0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.536278:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587758.536304:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587758.536310:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043881600:0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.536334:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587758.536364:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043881344:0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.536387:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587758.536405:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043881856:0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.536422:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587758.536451:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587758.536456:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043881472:0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.536474:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587758.536500:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043881216 00000100:00100000:3.0:1788587758.536506:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043881216 00000100:00100000:3.0:1788587758.536543:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788587758.536551:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043881216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.536590:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043881216:12345-0@lo:400:kworker.0 Request processed in 40us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587758.536596:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788587758.536621:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043881728 00000100:00100000:3.0:1788587758.536624:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043881728 00000100:00100000:3.0:1788587758.536650:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043881344 00000100:00100000:3.0:1788587758.536653:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043881344 00000100:00100000:3.0:1788587758.536666:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043881472 00000100:00100000:3.0:1788587758.536668:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043881472 00000100:00100000:3.0:1788587758.536682:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788587758.536687:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043881728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.536726:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043881728:12345-0@lo:400:kworker.0 Request processed in 38us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587758.536733:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788587758.536745:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788587758.536751:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043881344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.536782:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043881344:12345-0@lo:400:kworker.0 Request processed in 31us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587758.536787:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788587758.536798:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788587758.536804:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043881472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.536829:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043881472:12345-0@lo:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587758.536834:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788587758.536872:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043881600 00000100:00100000:3.0:1788587758.536876:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043881600 00000100:00100000:3.0:1788587758.536898:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043881856 00000100:00100000:3.0:1788587758.536900:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043881856 00000100:00100000:3.0:1788587758.536919:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587758.536925:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043881600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.536955:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043881600:12345-0@lo:400:kworker.0 Request processed in 30us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587758.536960:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587758.536970:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788587758.536976:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043881856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.537017:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043881856:12345-0@lo:400:kworker.0 Request processed in 41us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587758.537034:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788587758.537062:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587758.537066:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587758.537102:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043881472:0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.537111:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043881344:0@lo:400:kworker.0 00010000:00080000:3.0:1788587758.537122:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bb25bb80 x1875470043881856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587758.537131:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043881856:0@lo:400:kworker.0 00010000:00080000:3.0:1788587758.537162:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4833a1c00 x1875470043881600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587758.537170:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043881600:0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.537178:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043881216:0@lo:400:kworker.0 00000100:00100000:3.0:1788587758.537186:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043881728:0@lo:400:kworker.0 00000100:00100000:1.0:1788587758.537294:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043881984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587758.537324:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587758.537357:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043881984 00000100:00100000:1.0:1788587758.537361:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043881984 00000100:00100000:1.0:1788587758.537384:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788587758.537391:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043881984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587758.537416:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587758.537458:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043881984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587758.537464:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788587758.537492:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf76fb80 x1875470043881984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587758.537505:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043881984:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788587758.573404:0:10129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:55:56 (1788587756) === 00000100:00100000:2.0:1788587758.943043:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587758.943251:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026023424 00000100:00100000:3.0:1788587758.943260:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026023424 00000100:00100000:3.0:1788587758.943316:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 202 00000100:00100000:3.0:1788587758.943327:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:8106:x1875470026023424:12345-192.168.206.33@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788587758.943343:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587758.943361:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4baed4800/0xa13e120d54ca8335 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1075 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587758.943551:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed4800/0xa13e120d54ca8335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1075 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587758.943578:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4baed4800/0xa13e120d54ca8335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1075 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587758.943587:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed4800, rc 0) 00000100:00100000:3.0:1788587758.943645:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:8106:x1875470026023424:12345-192.168.206.33@tcp:101:mount.lustre.0 Request processed in 320us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587758.943652:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 202 00000100:00100000:2.0:1788587758.957470:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587758.960043:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026023552 00000100:00100000:3.0:1788587758.960258:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026023552 00000100:00100000:2.0:1788587758.965535:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 203 00000100:00100000:2.0:1788587758.965548:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:8106:x1875470026023552:12345-192.168.206.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788587758.965829:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:8106:x1875470026023552:12345-192.168.206.33@tcp:501:mount.lustre.0 Request processed in 283us (8367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587758.965837:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 203 00000100:00100000:2.0:1788587758.972814:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587758.977682:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026023680 00000100:00100000:3.0:1788587758.977706:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026023680 00000100:00100000:3.0:1788587758.977793:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 204 00000100:00100000:3.0:1788587758.978402:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:8106:x1875470026023680:12345-192.168.206.33@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788587758.979734:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:8106:x1875470026023680:12345-192.168.206.33@tcp:503:mount.lustre.0 Request processed in 1329us (6935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587758.979748:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 204 00000100:00100000:0.0:1788587758.991791:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587758.992257:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026023808 00000100:00100000:2.0:1788587758.992276:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026023808 00000100:00100000:2.0:1788587758.992676:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 205 00000100:00100000:2.0:1788587758.992689:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:8110:x1875470026023808:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587758.993155:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:8110:x1875470026023808:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 466us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587758.993165:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 205 00000100:00100000:2.0:1788587759.006085:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587759.006200:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026023936 00000100:00100000:1.0:1788587759.006214:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026023936 00000100:00100000:1.0:1788587759.006284:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 206 00000100:00100000:1.0:1788587759.006606:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:8110:x1875470026023936:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587759.008243:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:8110:x1875470026023936:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 1937us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587759.008261:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 206 00000100:00100000:1.0:1788587759.016923:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587759.017041:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026024064 00000100:00100000:2.0:1788587759.017054:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026024064 00000100:00100000:2.0:1788587759.017165:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 207 00000100:00100000:2.0:1788587759.017178:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:8106:x1875470026024064:12345-192.168.206.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587759.017200:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587759.017224:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c159d200/0xa13e120d54ca833c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db109f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587759.017262:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159d200/0xa13e120d54ca833c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db109f expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587759.017275:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c159d200/0xa13e120d54ca833c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db109f expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587759.017286:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d200, rc 0) 00000100:00100000:2.0:1788587759.017371:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:8106:x1875470026024064:12345-192.168.206.33@tcp:101:mount.lustre.0 Request processed in 196us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587759.017378:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 207 00000100:00100000:0.0:1788587759.032315:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587759.033155:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026024192 00000100:00100000:1.0:1788587759.033173:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026024192 00000100:00100000:1.0:1788587759.033254:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 208 00000100:00100000:1.0:1788587759.033267:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:8106:x1875470026024192:12345-192.168.206.33@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788587759.033303:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788587759.033336:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788587759.033340:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788587759.033344:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788587759.033346:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788587759.043910:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:8106:x1875470026024192:12345-192.168.206.33@tcp:256:mount.lustre.0 Request processed in 10628us (11593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587759.043928:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 208 00000100:00100000:3.0:1788587759.051408:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587759.051540:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026024320 00000100:00100000:0.0:1788587759.051554:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026024320 00000100:00100000:0.0:1788587759.051638:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 209 00000100:00100000:0.0:1788587759.051650:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:8106:x1875470026024320:12345-192.168.206.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788587759.051674:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587759.051697:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bf77bc00/0xa13e120d54ca8343 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db10a6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587759.051754:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bf77bc00/0xa13e120d54ca8343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10a6 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587759.051768:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bf77bc00/0xa13e120d54ca8343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10a6 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587759.052355:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77bc00, rc 0) 00000100:00100000:0.0:1788587759.052436:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:8106:x1875470026024320:12345-192.168.206.33@tcp:101:mount.lustre.0 Request processed in 787us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587759.052445:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 209 00010000:00010000:0.0:1788587759.056382:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587759.073299:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587759.073612:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026024448 00000100:00100000:3.0:1788587759.073626:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026024448 00000100:00100000:3.0:1788587759.073745:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 210 00000100:00100000:3.0:1788587759.073762:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:8106:x1875470026024448:12345-192.168.206.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788587759.081937:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:8106:x1875470026024448:12345-192.168.206.33@tcp:501:mount.lustre.0 Request processed in 8162us (8633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587759.081969:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 210 00000100:00100000:2.0:1788587759.089938:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587759.090079:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026024576 00000100:00100000:1.0:1788587759.090094:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026024576 00000100:00100000:1.0:1788587759.090216:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 211 00000100:00100000:1.0:1788587759.090229:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:8106:x1875470026024576:12345-192.168.206.33@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788587759.090562:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:8106:x1875470026024576:12345-192.168.206.33@tcp:503:mount.lustre.0 Request processed in 335us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587759.090572:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 211 00000100:00100000:1.0:1788587759.098195:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587759.104541:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026024704 00000100:00100000:2.0:1788587759.104562:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026024704 00000100:00100000:2.0:1788587759.104933:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 212 00000100:00100000:2.0:1788587759.104946:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:8113:x1875470026024704:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587759.106416:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:8113:x1875470026024704:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 1460us (8306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587759.106510:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 212 00000100:00100000:2.0:1788587759.114471:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587759.118303:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026024832 00000100:00100000:1.0:1788587759.118326:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026024832 00000100:00100000:1.0:1788587759.118484:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 213 00000100:00100000:1.0:1788587759.118496:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:8113:x1875470026024832:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587759.121746:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:8113:x1875470026024832:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 3231us (7271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587759.121766:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 213 00000100:00100000:0.0:1788587759.131957:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587759.132026:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587759.132201:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026024960 00000100:00100000:3.0:1788587759.132214:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026024960 00000100:00100000:3.0:1788587759.132280:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026025344 00000100:00100000:3.0:1788587759.132284:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026025344 00000100:00100000:3.0:1788587759.132342:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 53 00000100:00100000:3.0:1788587759.132374:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2347:x1875470026025344:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587759.132465:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:2.0:1788587759.132474:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2343:x1875470026024960:12345-192.168.206.33@tcp:38:mount.lustre.0 00000100:00100000:3.0:1788587759.132490:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2347:x1875470026025344:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 104us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587759.132500:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 53 00010000:00080000:2.0:1788587759.132509:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b66627bb-533c-4cf5-aca4-320057d76d08@192.168.206.33@tcp t0 exp 0000000000000000 cur 206 last 0 00000100:00080000:3.0:1788587759.132526:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1788587759.132557:0:5842:0:(genops.c:1385:class_connect()) connect: client b66627bb-533c-4cf5-aca4-320057d76d08, cookie 0xa13e120d54ca834a 00000004:00100000:2.0:1788587759.132675:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788587759.135532:0:5842:0:(import.c:65:import_set_state_nolock()) ffff88f4bf84c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587759.135782:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b66627bb-533c-4cf5-aca4-320057d76d08+6:2343:x1875470026024960:12345-192.168.206.33@tcp:38:mount.lustre.0 Request processed in 3301us (3837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587759.135796:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:0.0:1788587759.139282:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587759.139523:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026025216 00000100:00100000:3.0:1788587759.139536:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026025216 00000100:00100000:3.0:1788587759.139635:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:3.0:1788587759.139647:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b66627bb-533c-4cf5-aca4-320057d76d08+6:8106:x1875470026025216:12345-192.168.206.33@tcp:41:mount.lustre.0 00000100:00080000:0.0:1788587759.139766:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788587759.139830:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587759.139997:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b66627bb-533c-4cf5-aca4-320057d76d08+6:8106:x1875470026025216:12345-192.168.206.33@tcp:41:mount.lustre.0 Request processed in 341us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587759.140005:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:3.0:1788587759.142198:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587759.142386:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026025088 00000100:00100000:0.0:1788587759.142397:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026025088 00000100:00100000:0.0:1788587759.142464:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 12 00000100:00100000:0.0:1788587759.142485:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+6:0:x1875470026025088:12345-192.168.206.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788587759.142527:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587759.142615:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+6:0:x1875470026025088:12345-192.168.206.33@tcp:41:mount.lustre.0 Request processed in 141us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587759.142623:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 12 00000100:00100000:2.0:1788587759.144556:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587759.144642:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026025472 00000100:00100000:3.0:1788587759.144653:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026025472 00000100:00100000:3.0:1788587759.144728:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 13 00000100:00100000:3.0:1788587759.144739:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b66627bb-533c-4cf5-aca4-320057d76d08+6:8106:x1875470026025472:12345-192.168.206.33@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788587759.144893:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b66627bb-533c-4cf5-aca4-320057d76d08+6:8106:x1875470026025472:12345-192.168.206.33@tcp:40:mount.lustre.0 Request processed in 156us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587759.144903:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 13 00000100:00100000:2.0:1788587759.148506:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587759.148560:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587759.148597:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587759.148700:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026025600 00000100:00100000:1.0:1788587759.148713:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026025600 00000100:00100000:1.0:1788587759.148762:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026025728 00000100:00100000:1.0:1788587759.148766:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026025728 00000100:00100000:1.0:1788587759.148791:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 12 00000100:00100000:1.0:1788587759.148809:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2343:x1875470026025600:12345-192.168.206.33@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788587759.148886:0:9214:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b66627bb-533c-4cf5-aca4-320057d76d08@192.168.206.33@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:1.0:1788587759.148926:0:9214:0:(genops.c:1385:class_connect()) connect: client b66627bb-533c-4cf5-aca4-320057d76d08, cookie 0xa13e120d54ca8351 00002000:00100000:1.0:1788587759.148942:0:9214:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b66627bb-533c-4cf5-aca4-320057d76d08/ffff88f4bf6f0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788587759.149005:0:9214:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788587759.149542:0:9214:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788587759.149582:0:9214:0:(import.c:65:import_set_state_nolock()) ffff88f4bf6f2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587759.149658:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b66627bb-533c-4cf5-aca4-320057d76d08+6:2343:x1875470026025600:12345-192.168.206.33@tcp:8:mount.lustre.0 Request processed in 849us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587759.149668:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 12 00000100:00100000:0.0:1788587759.149786:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026025856 00000100:00100000:0.0:1788587759.149800:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026025856 00000100:00100000:0.0:1788587759.149861:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 1 00000100:00100000:0.0:1788587759.149879:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b66627bb-533c-4cf5-aca4-320057d76d08+6:8106:x1875470026025856:12345-192.168.206.33@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788587759.149958:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788587759.150014:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b66627bb-533c-4cf5-aca4-320057d76d08+6:8106:x1875470026025856:12345-192.168.206.33@tcp:33:mount.lustre.0 Request processed in 136us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587759.150020:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 1 00000100:00100000:0.0:1788587759.150066:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 13 00000100:00100000:0.0:1788587759.150072:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2343:x1875470026025728:12345-192.168.206.33@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788587759.150106:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b66627bb-533c-4cf5-aca4-320057d76d08@192.168.206.33@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:0.0:1788587759.150133:0:6695:0:(genops.c:1385:class_connect()) connect: client b66627bb-533c-4cf5-aca4-320057d76d08, cookie 0xa13e120d54ca8358 00002000:00100000:0.0:1788587759.150143:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b66627bb-533c-4cf5-aca4-320057d76d08/ffff88f4bf7dc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788587759.150154:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788587759.150485:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788587759.150507:0:6695:0:(import.c:65:import_set_state_nolock()) ffff88f4bf7db800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587759.150533:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b66627bb-533c-4cf5-aca4-320057d76d08+6:2343:x1875470026025728:12345-192.168.206.33@tcp:8:mount.lustre.0 Request processed in 461us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587759.150540:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 13 00000001:00100000:3.0:1788587759.663111:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b66627bb-533c-4cf5-aca4-320057d76d08 00010000:00010000:1.0:1788587760.072306:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587760.134164:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b66627bb-533c-4cf5-aca4-320057d76d08 00010000:00010000:0.0:1788587761.096724:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587762.124116:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587762.632544:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043882112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587762.632666:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587762.632895:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043882112 00000100:00100000:0.0:1788587762.632906:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043882112 00000100:00100000:0.0:1788587762.633004:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587762.633016:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043882112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587762.633071:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587762.633142:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043882112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587762.633149:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788587762.633177:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6f9880 x1875470043882112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587762.633201:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043882112:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788587762.633470:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788587763.145087:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788587763.220957:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b66627bb-533c-4cf5-aca4-320057d76d08 00000100:00100000:1.0:1788587763.656157:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb25a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043882368:0@lo:400:kworker.0 00000100:00100000:1.0:1788587763.656290:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587763.656355:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043882752:0@lo:400:kworker.0 00000100:00100000:1.0:1788587763.656388:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587763.656432:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587763.656439:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb25b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043882624:0@lo:400:kworker.0 00000100:00100000:1.0:1788587763.656608:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587763.656625:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043882240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587763.656653:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043882496:0@lo:400:kworker.0 00000100:00100000:3.0:1788587763.656671:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587763.656690:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587763.656701:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043882880:0@lo:400:kworker.0 00000100:00100000:1.0:1788587763.656717:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043883008:0@lo:400:kworker.0 00000100:00100000:3.0:1788587763.656733:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587763.656760:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587763.656778:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043882240 00000100:00100000:3.0:1788587763.656788:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043882240 00000100:00100000:1.0:1788587763.656806:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043882368 00000100:00100000:1.0:1788587763.656812:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043882368 00000100:00100000:1.0:1788587763.656884:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788587763.656886:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788587763.656897:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb25ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043882240:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587763.656915:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043882368:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788587763.656949:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587763.656985:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043882368:12345-0@lo:400:kworker.0 Request processed in 73us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587763.656995:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788587763.657011:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb25ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043882240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587763.657019:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788587763.657041:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043882624 00000100:00100000:1.0:1788587763.657047:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043882624 00000100:00100000:3.0:1788587763.657048:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043882496 00000100:00100000:3.0:1788587763.657054:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043882496 00000100:00100000:1.0:1788587763.657081:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043882880 00000100:00100000:1.0:1788587763.657086:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043882880 00000100:00100000:0.0:1788587763.657204:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043882752 00000100:00100000:0.0:1788587763.657210:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043882752 00000100:00100000:0.0:1788587763.657242:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043883008 00000100:00100000:0.0:1788587763.657245:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043883008 00000100:00100000:3.0:1788587763.657543:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788587763.657554:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043882624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587763.657588:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788587763.657598:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043882496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587763.657649:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043882496:12345-0@lo:400:kworker.0 Request processed in 53us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587763.657658:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788587763.657672:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043882624:12345-0@lo:400:kworker.0 Request processed in 119us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587763.657679:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788587763.657689:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043882880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587763.657701:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587763.657717:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043882752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587763.657725:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043882880:12345-0@lo:400:kworker.0 Request processed in 36us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587763.657765:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043882752:12345-0@lo:400:kworker.0 Request processed in 54us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587763.657773:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587763.657788:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587763.657794:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043883008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587763.657823:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043883008:12345-0@lo:400:kworker.0 Request processed in 29us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587763.657829:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587763.657946:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb25b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043882624:0@lo:400:kworker.0 00000100:00100000:0.0:1788587763.657971:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb25a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043882368:0@lo:400:kworker.0 00010000:00080000:0.0:1788587763.657988:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bb25b480 x1875470043882752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587763.658000:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043882752:0@lo:400:kworker.0 00000100:00100000:0.0:1788587763.658071:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043882496:0@lo:400:kworker.0 00010000:00080000:0.0:1788587763.658084:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bb259500 x1875470043883008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587763.658093:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043883008:0@lo:400:kworker.0 00000100:00080000:0.0:1788587763.658147:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587763.658153:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788587763.658187:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf76fb80 x1875470043882240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587763.658205:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043882240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587763.658225:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043882880:0@lo:400:kworker.0 00000100:00100000:3.0:1788587763.660545:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788587763.663991:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00010000:1.0:1788587764.168094:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587764.194645:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587764.194694:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587764.194734:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587764.194871:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026026112 00000100:00100000:2.0:1788587764.194897:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026026112 00000100:00100000:2.0:1788587764.194986:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 57 00000100:00100000:2.0:1788587764.194999:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026026112:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587764.195147:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026026368 00000100:00100000:3.0:1788587764.195163:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026026368 00000100:00100000:3.0:1788587764.195205:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 29 00000100:00100000:3.0:1788587764.195213:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026026368:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587764.196675:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026026112:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 1669us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587764.196690:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 57 00000100:00080000:2.0:1788587764.196738:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587764.197249:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587764.197803:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587764.197881:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026025984 00000100:00100000:1.0:1788587764.197891:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026025984 00000100:00100000:1.0:1788587764.197940:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 215 00000100:00100000:1.0:1788587764.197949:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2346:x1875470026025984:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587764.198045:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2346:x1875470026025984:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 95us (3309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587764.198053:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 215 00000100:00100000:1.0:1788587764.198092:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026026240 00000100:00100000:1.0:1788587764.198097:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026026240 00000100:00100000:1.0:1788587764.198139:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 58 00000100:00100000:1.0:1788587764.198146:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026026240:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587764.198190:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026026240:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 45us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587764.198197:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 58 00000100:00080000:1.0:1788587764.198219:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587764.201825:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026026368:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 6595us (7113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587764.201918:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 29 00000100:00100000:0.0:1788587764.205000:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587764.205336:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026026496 00000100:00100000:2.0:1788587764.205349:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026026496 00000100:00100000:2.0:1788587764.205422:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 30 00000100:00100000:2.0:1788587764.205433:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026026496:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587764.205596:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026026496:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 164us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587764.205604:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 30 00000100:00080000:2.0:1788587764.205806:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1788587764.499452:0:10325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg633-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788587765.193185:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587766.220247:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587767.241160:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587767.753958:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043883136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587767.754053:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587767.754338:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043883136 00000100:00100000:2.0:1788587767.754349:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043883136 00000100:00100000:2.0:1788587767.754446:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788587767.754458:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043883136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587767.754499:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587767.754554:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043883136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587767.754562:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788587767.754608:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b53aea00 x1875470043883136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587767.754629:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043883136:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788587767.754806:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788587768.270198:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587768.776164:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043883264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587768.776234:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587768.776419:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043883264 00000100:00100000:3.0:1788587768.776428:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043883264 00000100:00100000:3.0:1788587768.776496:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788587768.776506:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043883264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587768.776543:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587768.776602:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043883264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587768.776608:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788587768.776649:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf76f480 x1875470043883264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587768.776925:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587768.777000:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043883264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587768.777429:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043883520:0@lo:400:kworker.0 00000100:00100000:1.0:1788587768.777468:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587768.777498:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788587768.777503:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043883392:0@lo:400:kworker.0 00000100:00100000:1.0:1788587768.777526:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587768.777547:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875470043883904:0@lo:400:kworker.0 00000100:00100000:1.0:1788587768.777579:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587768.777617:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043883392 00000100:00100000:1.0:1788587768.777622:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043883392 00000100:00100000:1.0:1788587768.777663:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788587768.777669:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3303:x1875470043883392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587768.777693:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043883648:0@lo:400:kworker.0 00000100:00100000:1.0:1788587768.777709:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3303:x1875470043883392:12345-0@lo:400:kworker.0 Request processed in 38us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587768.777727:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788587768.777758:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043883520 00000100:00100000:1.0:1788587768.777761:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043883520 00000100:00100000:1.0:1788587768.777780:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043883904 00000100:00100000:1.0:1788587768.777782:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043883904 00000100:00100000:1.0:1788587768.777799:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788587768.777805:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043883520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587768.777830:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043883520:12345-0@lo:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587768.777835:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788587768.777866:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788587768.777872:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875470043883904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587768.777892:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875470043883904:12345-0@lo:400:kworker.0 Request processed in 22us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587768.777898:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788587768.777917:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587768.777945:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043883392:0@lo:400:kworker.0 00000100:00100000:1.0:1788587768.777957:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875470043883904:0@lo:400:kworker.0 00000100:00100000:1.0:1788587768.777964:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043883520:0@lo:400:kworker.0 00000100:00100000:2.0:1788587768.778155:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587768.778190:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043883648 00000100:00100000:0.0:1788587768.778197:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043883648 00000100:00100000:2.0:1788587768.778213:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587768.778226:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043883776:0@lo:400:kworker.0 00000100:00100000:0.0:1788587768.778236:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788587768.778246:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043883648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587768.778273:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788587768.778344:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587768.778414:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043883776 00000100:00100000:3.0:1788587768.778418:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043883776 00000100:00100000:3.0:1788587768.778452:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788587768.778459:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043883776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587768.786572:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043883648:12345-0@lo:400:kworker.0 Request processed in 8318us (8407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587768.786588:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788587768.787161:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043883648:0@lo:400:kworker.0 00000100:00100000:3.0:1788587768.791267:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043883776:12345-0@lo:400:kworker.0 Request processed in 12732us (12921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587768.791284:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788587768.792118:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f488f18e00 x1875470043883776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587768.792140:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043883776:0@lo:400:kworker.0 00010000:00010000:0.0:1788587769.288685:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587769.313912:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587769.313992:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026026624 00000100:00100000:1.0:1788587769.314002:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026026624 00000100:00100000:1.0:1788587769.314063:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 217 00000100:00100000:1.0:1788587769.314073:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026026624:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587769.314145:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026026624:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 73us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587769.314159:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 217 00000100:00100000:2.0:1788587769.314873:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587769.314908:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587769.314940:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587769.315043:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587769.315059:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026026880 00000100:00100000:1.0:1788587769.315064:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026026880 00000100:00100000:2.0:1788587769.315072:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026027136 00000100:00100000:2.0:1788587769.315074:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026027136 00000100:00100000:2.0:1788587769.315102:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026027008 00000100:00100000:1.0:1788587769.315102:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026026752 00000100:00100000:2.0:1788587769.315105:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026027008 00000100:00100000:1.0:1788587769.315105:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026026752 00000100:00100000:2.0:1788587769.315125:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 32 00000100:00100000:1.0:1788587769.315125:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 62 00000100:00100000:2.0:1788587769.315132:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026027136:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587769.315132:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026026880:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587769.315174:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026027136:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 42us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587769.315181:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 32 00000100:00100000:3.0:1788587769.315189:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 33 00000100:00100000:3.0:1788587769.315197:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026027008:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587769.315702:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026026880:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 568us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587769.315792:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 62 00000100:00100000:1.0:1788587769.315814:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 63 00000100:00100000:1.0:1788587769.315822:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2345:x1875470026026752:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587769.315985:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2345:x1875470026026752:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 163us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587769.315992:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 63 00000100:00080000:1.0:1788587769.316010:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587769.316014:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587769.316017:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587769.316299:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026027008:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 1102us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587769.316307:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 33 00010000:00010000:0.0:1788587770.312319:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587771.338632:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587772.365049:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587772.875524:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4867b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043884032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587772.875591:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587772.875825:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043884032 00000100:00100000:2.0:1788587772.875832:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043884032 00000100:00100000:2.0:1788587772.875928:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788587772.875936:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043884032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587772.875968:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587772.876010:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043884032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587772.876016:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788587772.876130:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788587772.876160:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4867b4000 x1875470043884032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587772.876179:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4867b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043884032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788587773.385933:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587773.896351:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043884160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587773.896424:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587773.896733:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043884160 00000100:00100000:0.0:1788587773.896741:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043884160 00000100:00100000:0.0:1788587773.896800:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587773.896822:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043884160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587773.896873:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788587773.898634:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587773.901366:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4867b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043884288:0@lo:400:kworker.0 00000100:00100000:2.0:1788587773.901433:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587773.901471:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043884800:0@lo:400:kworker.0 00000100:00100000:2.0:1788587773.901501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587773.902048:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4867b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043884416:0@lo:400:kworker.0 00000100:00100000:2.0:1788587773.902635:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587773.902643:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043884672:0@lo:400:kworker.0 00000100:00100000:2.0:1788587773.902670:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587773.902696:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4867b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043884544:0@lo:400:kworker.0 00000100:00100000:2.0:1788587773.902719:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587773.902751:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043884288 00000100:00100000:2.0:1788587773.902759:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043884288 00000100:00100000:2.0:1788587773.902801:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788587773.902809:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043884288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587773.902865:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043884288:12345-0@lo:400:kworker.0 Request processed in 57us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587773.902872:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788587773.902915:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043884672 00000100:00100000:2.0:1788587773.902919:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043884672 00000100:00100000:2.0:1788587773.902948:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587773.902957:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043884672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587773.902958:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043884160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6134us (6529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587773.902972:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788587773.903007:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043884672:12345-0@lo:400:kworker.0 Request processed in 53us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587773.903015:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587773.903105:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043884800 00000100:00100000:2.0:1788587773.903109:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043884800 00000100:00100000:2.0:1788587773.903153:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043884544 00000100:00100000:2.0:1788587773.903157:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043884544 00000100:00100000:2.0:1788587773.903241:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788587773.903249:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043884800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587773.903278:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043884800:12345-0@lo:400:kworker.0 Request processed in 32us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587773.903284:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788587773.903295:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788587773.903300:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043884544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587773.903325:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043884544:12345-0@lo:400:kworker.0 Request processed in 25us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587773.903330:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788587773.903382:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4867b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043884544:0@lo:400:kworker.0 00000100:00100000:2.0:1788587773.903407:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587773.903438:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043884416 00000100:00100000:2.0:1788587773.903441:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043884416 00000100:00100000:2.0:1788587773.903462:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788587773.903468:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043884416:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788587773.903835:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587773.904693:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043884416:12345-0@lo:400:kworker.0 Request processed in 1221us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587773.904703:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1788587773.904760:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4baa51500 x1875470043884672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587773.904773:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043884672:0@lo:400:kworker.0 00000100:00100000:2.0:1788587773.904783:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4867b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043884288:0@lo:400:kworker.0 00000100:00100000:2.0:1788587773.904793:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043884800:0@lo:400:kworker.0 00010000:00080000:3.0:1788587773.905351:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf6fbb80 x1875470043884160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587773.905373:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043884160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587773.907660:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4867b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043884416:0@lo:400:kworker.0 00010000:00010000:0.0:1788587774.408001:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587774.432543:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587774.432588:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587774.432637:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587774.432661:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587774.432696:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587774.432725:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026027520 00000100:00100000:1.0:1788587774.432733:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026027520 00000100:00100000:1.0:1788587774.432785:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026027392 00000100:00100000:1.0:1788587774.432789:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026027392 00000100:00100000:1.0:1788587774.432813:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 67 00000100:00100000:1.0:1788587774.432823:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026027520:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587774.432924:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026027520:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 101us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587774.432931:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 67 00000100:00100000:1.0:1788587774.432949:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 68 00000100:00100000:1.0:1788587774.432956:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026027392:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587774.432981:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026027392:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587774.432987:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 68 00000100:00100000:1.0:1788587774.433004:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026027776 00000100:00100000:1.0:1788587774.433008:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026027776 00000100:00100000:1.0:1788587774.433032:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026027648 00000100:00100000:1.0:1788587774.433035:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026027648 00000100:00100000:1.0:1788587774.433060:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 35 00000100:00100000:1.0:1788587774.433137:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026027776:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587774.433164:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026027776:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 92us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587774.433171:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 35 00000100:00100000:1.0:1788587774.433182:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 36 00000100:00100000:1.0:1788587774.433188:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026027648:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587774.433208:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026027648:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 21us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587774.433213:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 36 00000100:00080000:1.0:1788587774.433234:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587774.433238:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587774.433240:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587774.437013:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026027264 00000100:00100000:3.0:1788587774.437024:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026027264 00000100:00100000:3.0:1788587774.437183:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 219 00000100:00100000:3.0:1788587774.437195:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2346:x1875470026027264:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587774.437293:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2346:x1875470026027264:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 101us (4759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587774.437300:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 219 00010000:00010000:3.0:1788587775.437458:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587776.460329:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587777.482998:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587778.000235:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043884928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587778.000444:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587778.000588:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043884928 00000100:00100000:3.0:1788587778.000599:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043884928 00000100:00100000:3.0:1788587778.000675:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788587778.000686:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043884928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587778.000728:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587778.000778:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043884928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587778.000801:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788587778.002041:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788587778.002629:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bb25aa00 x1875470043884928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587778.002661:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043884928:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788587778.503959:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587779.016615:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043885312:0@lo:400:kworker.0 00000100:00100000:2.0:1788587779.016681:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587779.016740:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788587779.016746:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043885184:0@lo:400:kworker.0 00000100:00100000:2.0:1788587779.016787:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587779.016805:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4867b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043885696:0@lo:400:kworker.0 00000100:00100000:2.0:1788587779.016826:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587779.016875:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043885312 00000100:00100000:2.0:1788587779.016893:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043885312 00000100:00100000:2.0:1788587779.016944:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043885184 00000100:00100000:2.0:1788587779.016947:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043885184 00000100:00100000:2.0:1788587779.016964:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788587779.016971:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043885312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587779.017015:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043885312:12345-0@lo:400:kworker.0 Request processed in 44us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587779.017022:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788587779.017038:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788587779.017044:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043885184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587779.017068:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043885184:12345-0@lo:400:kworker.0 Request processed in 24us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587779.017081:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788587779.017116:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043885184:0@lo:400:kworker.0 00000100:00100000:2.0:1788587779.017126:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043885312:0@lo:400:kworker.0 00000100:00100000:0.0:1788587779.017313:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043885056:0@lo:400:kworker.0 00000100:00100000:0.0:1788587779.017347:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587779.017384:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4867b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875470043885568:0@lo:400:kworker.0 00000100:00100000:0.0:1788587779.017403:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587779.017418:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587779.017423:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043885440:0@lo:400:kworker.0 00000100:00100000:0.0:1788587779.017438:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587779.017580:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043885056 00000100:00100000:2.0:1788587779.017585:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043885056 00000100:00100000:1.0:1788587779.017709:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043885568 00000100:00100000:1.0:1788587779.017713:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043885568 00000100:00100000:1.0:1788587779.017741:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788587779.017747:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875470043885568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587779.017784:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875470043885568:12345-0@lo:400:kworker.0 Request processed in 38us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587779.017798:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788587779.017818:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043885696 00000100:00100000:1.0:1788587779.017822:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043885696 00000100:00100000:1.0:1788587779.017859:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043885440 00000100:00100000:1.0:1788587779.017862:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043885440 00000100:00100000:1.0:1788587779.017891:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788587779.017897:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043885696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587779.017930:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043885696:12345-0@lo:400:kworker.0 Request processed in 34us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587779.017936:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788587779.017946:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788587779.017951:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043885440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587779.017971:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043885440:12345-0@lo:400:kworker.0 Request processed in 20us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587779.017976:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788587779.017990:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587779.017993:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587779.017995:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788587779.018035:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4baa51f80 x1875470043885440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587779.018046:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043885440:0@lo:400:kworker.0 00000100:00100000:1.0:1788587779.018056:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4867b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875470043885568:0@lo:400:kworker.0 00010000:00080000:1.0:1788587779.018085:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4867b5180 x1875470043885696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587779.018094:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4867b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043885696:0@lo:400:kworker.0 00000100:00100000:2.0:1788587779.018170:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788587779.018179:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3303:x1875470043885056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587779.018220:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3303:x1875470043885056:12345-0@lo:400:kworker.0 Request processed in 43us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587779.018226:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788587779.018289:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043885056:0@lo:400:kworker.0 00000100:00100000:1.0:1788587779.023552:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587779.023571:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf5e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043885824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587779.023628:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587779.023672:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043885824 00000100:00100000:1.0:1788587779.023678:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043885824 00000100:00100000:1.0:1788587779.023728:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788587779.023737:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043885824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587779.023767:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587779.023804:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043885824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587779.023810:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788587779.023891:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf5e5500 x1875470043885824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587779.023908:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf5e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043885824:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788587779.528083:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587779.552257:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587779.552741:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026028288 00000100:00100000:2.0:1788587779.552751:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026028288 00000100:00100000:0.0:1788587779.554566:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 14 00000100:00100000:0.0:1788587779.554586:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b66627bb-533c-4cf5-aca4-320057d76d08+5:2343:x1875470026028288:12345-192.168.206.33@tcp:9:kworker.0 00000020:00000080:0.0:1788587779.554620:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8351 00000100:00080000:1.0:1788587779.554626:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587779.554629:0:6694:0:(import.c:65:import_set_state_nolock()) ffff88f4bf6f2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788587779.554680:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788587779.555052:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b66627bb-533c-4cf5-aca4-320057d76d08+2:2343:x1875470026028288:12345-192.168.206.33@tcp:9:kworker.0 Request processed in 473us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587779.555060:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 14 00010000:00010000:2.0:1788587779.555382:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587779.558509:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587779.558554:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587779.558594:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587779.558595:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026027904 00000100:00100000:3.0:1788587779.558612:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026027904 00000100:00100000:1.0:1788587779.558697:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587779.558733:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026028416 00000100:00100000:1.0:1788587779.558741:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026028416 00000100:00100000:1.0:1788587779.558792:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 15 00000100:00100000:1.0:1788587779.558801:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2343:x1875470026028416:12345-192.168.206.33@tcp:9:kworker.0 00000020:00000080:1.0:1788587779.558838:0:9214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8358 00000100:00080000:1.0:1788587779.558891:0:9214:0:(import.c:65:import_set_state_nolock()) ffff88f4bf7db800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788587779.558925:0:9214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788587779.559219:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026028160 00000100:00100000:0.0:1788587779.559224:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026028160 00000100:00100000:0.0:1788587779.559257:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026028032 00000100:00100000:0.0:1788587779.559260:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026028032 00000100:00100000:0.0:1788587779.559294:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 72 00000100:00100000:0.0:1788587779.559301:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+5:2344:x1875470026028160:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587779.559359:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+5:2344:x1875470026028160:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 58us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587779.559366:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 72 00000100:00100000:0.0:1788587779.559383:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 73 00000100:00100000:0.0:1788587779.559389:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2344:x1875470026028032:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587779.559413:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2344:x1875470026028032:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 24us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587779.559418:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 73 00000100:00100000:3.0:1788587779.559778:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 221 00000100:00100000:3.0:1788587779.559793:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2344:x1875470026027904:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587779.559887:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2344:x1875470026027904:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 86us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587779.559896:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 221 00000100:00100000:1.0:1788587779.563253:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b66627bb-533c-4cf5-aca4-320057d76d08+2:2343:x1875470026028416:12345-192.168.206.33@tcp:9:kworker.0 Request processed in 4445us (4549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587779.563266:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 15 00000100:00080000:1.0:1788587779.563308:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587779.563314:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788587779.563323:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587780.555622:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788587780.642832:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b66627bb-533c-4cf5-aca4-320057d76d08 00000020:00000080:0.0:1788587780.642886:0:7648:0:(genops.c:885:class_export_put()) final put ffff88f4bf7dc800/b66627bb-533c-4cf5-aca4-320057d76d08 00000020:00000080:3.0:1788587780.642939:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bf7dc800/b66627bb-533c-4cf5-aca4-320057d76d08 for lustre-OST0001 00000020:00000080:3.0:1788587780.643038:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4bf7db800 for lustre-OST0001 00000001:02000400:0.0:1788587781.437683:0:11027:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788587781.576189:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587782.601073:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587783.112580:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587783.112605:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043885952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587783.112673:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587783.112813:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043885952 00000100:00100000:3.0:1788587783.112820:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043885952 00000100:00080000:2.0:1788587783.112892:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587783.112913:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788587783.112923:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043885952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587783.112956:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587783.113013:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043885952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587783.113020:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788587783.113252:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bb25aa00 x1875470043885952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587783.113271:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043885952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788587783.629743:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788587783.660592:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b66627bb-533c-4cf5-aca4-320057d76d08 00000020:00000080:0.0:1788587783.660602:0:6718:0:(genops.c:885:class_export_put()) final put ffff88f4bf6f0000/b66627bb-533c-4cf5-aca4-320057d76d08 00000020:00000080:1.0:1788587783.660666:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bf6f0000/b66627bb-533c-4cf5-aca4-320057d76d08 for lustre-OST0000 00000020:00000080:1.0:1788587783.660719:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4bf6f2000 for lustre-OST0000 00000100:00100000:2.0:1788587784.136209:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043886080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587784.136273:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587784.136457:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043886080 00000100:00100000:1.0:1788587784.136465:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043886080 00000100:00100000:1.0:1788587784.136522:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788587784.136530:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043886080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587784.136561:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587784.136622:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043886080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587784.136628:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788587784.136664:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf5e6a00 x1875470043886080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587784.136679:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043886080:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788587784.136800:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587784.136982:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043886592:0@lo:400:kworker.0 00000100:00100000:0.0:1788587784.137013:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587784.137037:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587784.137042:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043886464:0@lo:400:kworker.0 00000100:00100000:0.0:1788587784.137065:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587784.137092:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043886592 00000100:00100000:0.0:1788587784.137109:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043886592 00000100:00100000:0.0:1788587784.137141:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788587784.137147:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043886592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587784.137185:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043886592:12345-0@lo:400:kworker.0 Request processed in 39us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587784.137192:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788587784.137212:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043886464 00000100:00100000:0.0:1788587784.137216:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043886464 00000100:00100000:0.0:1788587784.137244:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788587784.137251:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043886464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587784.137279:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043886464:12345-0@lo:400:kworker.0 Request processed in 29us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587784.137285:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788587784.137304:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587784.137323:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043886464:0@lo:400:kworker.0 00010000:00080000:0.0:1788587784.137333:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f488f1a680 x1875470043886592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587784.137342:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043886592:0@lo:400:kworker.0 00000100:00100000:2.0:1788587784.137454:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043886336:0@lo:400:kworker.0 00000100:00100000:2.0:1788587784.137482:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587784.137503:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788587784.137508:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043886208:0@lo:400:kworker.0 00000100:00100000:2.0:1788587784.137544:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587784.137566:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043886720:0@lo:400:kworker.0 00000100:00100000:2.0:1788587784.137585:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587784.137620:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043886336 00000100:00100000:2.0:1788587784.137624:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043886336 00000100:00100000:2.0:1788587784.137645:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043886720 00000100:00100000:2.0:1788587784.137648:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043886720 00000100:00100000:2.0:1788587784.137669:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788587784.137674:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043886336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587784.137707:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043886336:12345-0@lo:400:kworker.0 Request processed in 32us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587784.137713:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788587784.137725:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788587784.137732:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043886720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587784.137758:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043886720:12345-0@lo:400:kworker.0 Request processed in 27us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587784.137763:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788587784.137778:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043886208 00000100:00100000:2.0:1788587784.137782:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043886208 00000100:00100000:2.0:1788587784.137801:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788587784.137807:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043886208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587784.137832:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043886208:12345-0@lo:400:kworker.0 Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587784.137838:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788587784.137896:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043886208:0@lo:400:kworker.0 00000100:00100000:2.0:1788587784.137907:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043886720:0@lo:400:kworker.0 00000100:00100000:2.0:1788587784.137924:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043886336:0@lo:400:kworker.0 00000100:00080000:2.0:1788587784.137956:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788587784.649411:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587784.675541:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587784.676526:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587784.677511:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587784.677665:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026028544 00000100:00100000:0.0:1788587784.677679:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026028544 00000100:00100000:0.0:1788587784.677741:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 223 00000100:00100000:0.0:1788587784.677753:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2346:x1875470026028544:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587784.677869:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2346:x1875470026028544:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 117us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587784.677878:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 223 00000100:00100000:2.0:1788587784.678301:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026028672 00000100:00100000:2.0:1788587784.678309:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026028672 00000100:00100000:2.0:1788587784.678440:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026028800 00000100:00100000:2.0:1788587784.678444:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026028800 00000100:00100000:2.0:1788587784.678471:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 77 00000100:00100000:2.0:1788587784.678481:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026028672:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587784.678529:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026028672:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 51us (3003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587784.678536:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 77 00000100:00100000:1.0:1788587784.678658:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 78 00000100:00100000:1.0:1788587784.678669:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026028800:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587784.678700:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026028800:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 34us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587784.678706:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 78 00000100:00080000:0.0:1788587784.679702:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1788587785.067409:0:11177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0b2ef330 20000000:00000080:2.0:1788587785.067438:0:11177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88f4bf684800 uarg=0000000000000000 20000000:01000000:2.0:1788587785.067491:0:11177:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788587785.067498:0:11177:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788587785.067504:0:11177:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788587785.072540:0:11178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788587785.073231:0:11177:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788587785.082221:0:11177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788587785.082574:0:11177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587785.082601:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4bf77a800/0xa13e120d54ca82c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca82be expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587785.082622:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4baed5c00/0xa13e120d54ca82ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca82e8 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587785.082655:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca8319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8312 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587785.082667:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca832e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db106e expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587785.082675:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4bf77bc00/0xa13e120d54ca8343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10a6 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587785.082684:0:11177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587785.082756:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4bf77bc00/0xa13e120d54ca8343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10a6 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587785.082778:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f4bf77bc00/0xa13e120d54ca8343 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10a6 expref: 12 pid: 5834 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587785.082798:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb25b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875470043886848:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587785.092117:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca832e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db106e expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587785.092143:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca832e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db106e expref: 12 pid: 5834 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587785.092162:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb259500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875470043886976:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587785.092220:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca8319 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca8312 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587785.092250:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca8319 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca8312 expref: 18 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587785.092261:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb258000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875470043887104:0@lo:104: 00000100:00100000:3.0:1788587785.092322:0:11177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587785.092368:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4baed5c00/0xa13e120d54ca82ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca82e8 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587785.092377:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f4baed5c00/0xa13e120d54ca82ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca82e8 expref: 18 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587785.092386:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb25a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875470043887232:0@lo:104: 00000100:00100000:3.0:1788587785.092407:0:11177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587785.092443:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4bf77a800/0xa13e120d54ca82c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca82be expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587785.092451:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f4bf77a800/0xa13e120d54ca82c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca82be expref: 18 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587785.092458:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb25aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875470043887360:0@lo:104: 00000100:00100000:3.0:1788587785.092479:0:11177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587785.092490:0:11177:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bab08840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587785.092670:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043887104 00000100:00100000:2.0:1788587785.092680:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043887104 00000100:00100000:2.0:1788587785.092733:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043887232 00000100:00100000:2.0:1788587785.092736:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043887232 00000100:00100000:2.0:1788587785.092747:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043887360 00000100:00100000:2.0:1788587785.092749:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043887360 00000100:00100000:2.0:1788587785.092763:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587785.092773:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb25b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+5:11177:x1875470043887104:12345-0@lo:104: 00010000:00010000:2.0:1788587785.092790:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8319 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.092912:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788587785.092920:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb25b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+5:11177:x1875470043887104:12345-0@lo:104: Request processed in 148us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587785.092928:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587785.092951:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587785.092958:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb25b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+4:11177:x1875470043887232:12345-0@lo:104: 00010000:00010000:2.0:1788587785.092967:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca82ef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093004:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788587785.093010:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb25b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+4:11177:x1875470043887232:12345-0@lo:104: Request processed in 54us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587785.093017:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587785.093031:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587785.093037:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4806a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:11177:x1875470043887360:12345-0@lo:104: 00010000:00010000:2.0:1788587785.093045:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca82c5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093074:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788587785.093079:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4806a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:11177:x1875470043887360:12345-0@lo:104: Request processed in 43us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587785.093086:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788587785.093105:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788587785.093112:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8319 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093131:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481668a00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:2.0:1788587785.093136:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca8319 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093145:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca8319 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587785.093153:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca8319 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587785.093159:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587785.093195:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8319 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093202:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587785.093226:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8319 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093234:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481668a00/0xa13e120d54ca8312 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8319 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093254:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587785.093258:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca82ef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093265:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481538a00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:2.0:1788587785.093269:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca82ef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093299:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca82ef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587785.093309:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca82ef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587785.093316:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587785.093340:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca82ef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093370:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587785.093397:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca82ef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093408:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481538a00/0xa13e120d54ca82e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca82ef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093423:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587785.093427:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca82c5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093434:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5000 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:2.0:1788587785.093437:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca82c5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093445:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca82c5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587785.093453:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca82c5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587785.093470:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587785.093487:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca82c5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093495:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587785.093505:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca82c5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093514:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f4baed5000/0xa13e120d54ca82be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca82c5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.093533:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587785.093535:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587785.093537:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587785.093571:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043887488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587785.093640:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587785.093683:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043887616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587785.093710:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587785.093730:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587785.093735:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043887744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587785.093755:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587785.093787:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043887488 00000100:00100000:2.0:1788587785.093795:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043887488 00010000:00010000:2.0:1788587785.093830:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca8319 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8312 expref: 19 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587785.093973:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043887616 00000100:00100000:2.0:1788587785.093980:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043887616 00010000:00010000:2.0:1788587785.094020:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4baed5c00/0xa13e120d54ca82ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca82e8 expref: 20 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587785.094045:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043887744 00000100:00100000:2.0:1788587785.094050:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043887744 00010000:00010000:2.0:1788587785.094072:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4bf77a800/0xa13e120d54ca82c5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca82be expref: 21 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587785.094100:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788587785.094112:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485c35050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+21:3305:x1875470043887488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587785.094126:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587785.094136:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca8319 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8312 expref: 21 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587785.094139:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb258000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875470043887104:0@lo:104: 00000100:00100000:3.0:1788587785.094159:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb25a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875470043887232:0@lo:104: 00010000:00010000:2.0:1788587785.094160:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca8319 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca8312 expref: 21 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587785.094172:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb25aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875470043887360:0@lo:104: 00010000:00010000:2.0:1788587785.094205:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca8319 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca8312 expref: 21 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.094224:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587785.094275:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485c35050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+20:3305:x1875470043887488:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587785.094285:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788587785.094355:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587785.094365:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043887616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587785.094376:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587785.094383:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4baed5c00/0xa13e120d54ca82ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca82e8 expref: 19 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.094412:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4baed5c00/0xa13e120d54ca82ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca82e8 expref: 19 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.094425:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed5c00/0xa13e120d54ca82ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca82e8 expref: 19 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.094436:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587785.094478:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:3302:x1875470043887616:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587785.094484:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587785.094506:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788587785.094516:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:3302:x1875470043887744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587785.094529:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587785.094536:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4bf77a800/0xa13e120d54ca82c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca82be expref: 17 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.094546:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4bf77a800/0xa13e120d54ca82c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca82be expref: 17 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.094560:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4bf77a800/0xa13e120d54ca82c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca82be expref: 17 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.094571:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587785.094593:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:3302:x1875470043887744:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587785.094600:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788587785.094642:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043887744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587785.094650:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043887616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587785.094991:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043887488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587785.096502:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587785.119630:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587785.119679:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb25b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875470043886848:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587785.119684:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587785.119719:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb259500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875470043886976:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587785.119766:0:11177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587785.119905:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026029056 00000100:00100000:2.0:1788587785.119913:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026029056 00010000:00010000:2.0:1788587785.119962:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca832e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db106e expref: 13 pid: 5834 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587785.120005:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026028928 00000100:00100000:2.0:1788587785.120009:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026028928 00010000:00010000:2.0:1788587785.120026:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4bf77bc00/0xa13e120d54ca8343 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10a6 expref: 14 pid: 5834 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587785.120047:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 28 00000100:00100000:2.0:1788587785.120056:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+14:2344:x1875470026029056:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587785.120076:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587785.120082:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca832e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db106e expref: 14 pid: 5834 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120093:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca832e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db106e expref: 14 pid: 5834 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120115:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca832e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db106e expref: 14 pid: 5834 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120135:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587785.120204:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2344:x1875470026029056:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 148us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587785.120212:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 28 00000100:00100000:2.0:1788587785.120246:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 29 00000100:00100000:2.0:1788587785.120253:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:2344:x1875470026028928:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587785.120273:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587785.120278:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4bf77bc00/0xa13e120d54ca8343 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10a6 expref: 12 pid: 5834 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120288:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4bf77bc00/0xa13e120d54ca8343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10a6 expref: 12 pid: 5834 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120300:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4bf77bc00/0xa13e120d54ca8343 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10a6 expref: 12 pid: 5834 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120313:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120323:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120342:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120349:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120357:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120364:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120370:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587785.120374:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120394:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120407:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.120416:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587785.120438:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:2344:x1875470026028928:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 185us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587785.120446:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 29 00010000:00010000:3.0:1788587785.120819:0:11177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587785.120829:0:11177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587785.120836:0:11177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed4000/0xa13e120d54ca835f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587785.672086:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587786.397882:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587786.398010:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026029184 00000100:00100000:2.0:1788587786.398020:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026029184 00000100:00100000:2.0:1788587786.398065:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 224 00000100:00100000:2.0:1788587786.398074:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:5587:x1875470026029184:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587786.398088:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587786.398106:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca8366 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db10d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587786.398133:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca8366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d0 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587786.398145:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca8366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d0 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587786.398152:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d000, rc 0) 00000100:00100000:2.0:1788587786.398220:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:5587:x1875470026029184:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 Request processed in 134us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587786.398237:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 224 00000100:00100000:0.0:1788587786.408171:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587786.408250:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026029312 00000100:00100000:1.0:1788587786.408259:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026029312 00000100:00100000:1.0:1788587786.408307:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 225 00000100:00100000:1.0:1788587786.408317:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:5587:x1875470026029312:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587786.408695:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:5587:x1875470026029312:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 Request processed in 378us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587786.408703:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 225 00000100:00100000:2.0:1788587786.412996:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587786.413070:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026029440 00000100:00100000:3.0:1788587786.413080:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026029440 00000100:00100000:3.0:1788587786.413131:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 226 00000100:00100000:3.0:1788587786.413142:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:5587:x1875470026029440:12345-192.168.206.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587786.413373:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:5587:x1875470026029440:12345-192.168.206.33@tcp:503:ll_cfg_requeue.0 Request processed in 232us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587786.413381:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 226 00000100:00100000:0.0:1788587786.426138:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587786.426449:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026029568 00000100:00100000:3.0:1788587786.426458:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026029568 00000100:00100000:0.0:1788587786.426654:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 227 00000100:00100000:0.0:1788587786.426667:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:5587:x1875470026029568:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587786.426684:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587786.426704:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca836d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db10d7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587786.426732:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca836d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d7 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587786.426743:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca836d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d7 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587786.426753:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b600, rc 0) 00000100:00100000:0.0:1788587786.426812:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:5587:x1875470026029568:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 Request processed in 148us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587786.426819:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 227 00000100:00100000:2.0:1788587786.431817:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587786.431992:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026029696 00000100:00100000:3.0:1788587786.432002:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026029696 00000100:00100000:3.0:1788587786.432056:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 228 00000100:00100000:3.0:1788587786.432067:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:5587:x1875470026029696:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587786.432331:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:5587:x1875470026029696:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 Request processed in 265us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587786.432354:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 228 00000100:00100000:2.0:1788587786.438265:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587786.438370:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026029824 00000100:00100000:3.0:1788587786.438387:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026029824 00000100:00100000:3.0:1788587786.438465:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 229 00000100:00100000:3.0:1788587786.438598:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:5587:x1875470026029824:12345-192.168.206.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587786.439036:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:5587:x1875470026029824:12345-192.168.206.33@tcp:503:ll_cfg_requeue.0 Request processed in 365us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587786.439050:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 229 10000000:01000000:0.0:1788587786.696015:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587786.696022:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f4b487a800 from 7 10000000:01000000:0.0:1788587786.696026:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587786.696071:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587786.696084:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587786.696095:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587786.696128:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043887872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587786.696198:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587786.696252:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7ba600 going to sleep for 11 seconds 00010000:00010000:1.0:1788587786.696367:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587786.696485:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043887872 00000100:00100000:2.0:1788587786.696493:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043887872 00000100:00100000:2.0:1788587786.696544:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788587786.696554:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043887872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587786.696566:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587786.696579:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c159ca00/0xa13e120d54ca837b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8374 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587786.696603:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159ca00/0xa13e120d54ca837b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8374 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587786.696624:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c159ca00/0xa13e120d54ca837b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8374 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587786.696633:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159ca00, rc 0) 00000100:00100000:2.0:1788587786.696670:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043887872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587786.696676:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788587786.696828:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043887872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587786.696881:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca837b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587786.696891:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca837b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587786.696952:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587786.696980:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587786.696994:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7ba600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587786.697181:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043888000 00000100:00100000:2.0:1788587786.697186:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043888000 00000100:00100000:2.0:1788587786.697210:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788587786.697217:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043888000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587786.697590:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043888000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 373us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587786.697604:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788587786.697705:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587786.697739:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587786.697779:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587786.697804:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7ba600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587786.697817:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043888128 00000100:00100000:0.0:1788587786.697820:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043888128 00000100:00100000:0.0:1788587786.697874:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788587786.697882:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043888128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587786.698022:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043888128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587786.698028:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788587786.698083:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788587786.699058:0:11227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788587786.704970:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788587786.705012:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587786.705023:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca837b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587786.705035:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca837b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587786.705142:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587786.705146:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f4baee9800 from 7 10000000:01000000:1.0:1788587786.705149:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587786.705195:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587786.705203:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587786.705213:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587786.705236:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf5e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587786.705297:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587786.705442:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf678240 going to sleep for 11 seconds 00000100:00100000:0.0:1788587786.713171:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043888256 00000100:00100000:0.0:1788587786.713185:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043888256 00000100:00100000:0.0:1788587786.713250:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788587786.713261:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043888256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587786.713278:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587786.713296:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bf77be00/0xa13e120d54ca8389 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8382 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587786.713331:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bf77be00/0xa13e120d54ca8389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8382 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587786.713357:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bf77be00/0xa13e120d54ca8389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8382 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587786.713367:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77be00, rc 0) 00000100:00100000:0.0:1788587786.713445:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043888256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (8147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587786.713452:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788587786.713512:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf5e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587786.713532:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8389 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587786.713542:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca8389 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587786.713610:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587786.713652:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587786.713682:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7ba180 going to sleep for 11 seconds 00000100:00100000:2.0:1788587786.714179:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043888384 00000100:00100000:2.0:1788587786.714186:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043888384 00000100:00100000:2.0:1788587786.714222:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788587786.714230:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043888384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587786.714508:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043888384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587786.714515:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788587786.714677:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587786.714714:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587786.714754:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587786.714785:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7ba180 going to sleep for 11 seconds 00000100:00100000:2.0:1788587786.715427:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043888512 00000100:00100000:2.0:1788587786.715432:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043888512 00000100:00100000:2.0:1788587786.715466:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788587786.715473:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043888512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587786.715634:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043888512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587786.715641:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788587786.716345:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788587786.717192:0:11228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788587786.718444:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788587786.718476:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587786.718487:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8389 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587786.718499:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8389 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587786.718509:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788587786.718512:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f488106000 from 7 10000000:01000000:2.0:1788587786.718514:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587786.718557:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587786.718572:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587786.718583:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587786.718608:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587786.718667:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587786.718710:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bfc6ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587786.718803:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043888640 00000100:00100000:0.0:1788587786.718810:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043888640 00000100:00100000:0.0:1788587786.718877:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788587786.718887:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043888640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587786.718898:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587786.718911:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bf77ba00/0xa13e120d54ca8397 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca8390 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587786.718937:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bf77ba00/0xa13e120d54ca8397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca8390 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587786.718949:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bf77ba00/0xa13e120d54ca8397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8390 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587786.718958:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77ba00, rc 0) 00000100:00100000:0.0:1788587786.719001:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043888640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587786.719008:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788587786.719051:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587786.719073:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8397 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587786.719081:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca8397 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587786.719134:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587786.719160:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587786.719174:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f483968cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587786.719186:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043888768 00000100:00100000:0.0:1788587786.719189:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043888768 00000100:00100000:0.0:1788587786.719205:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788587786.719211:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043888768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587786.720543:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043888768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1327us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587786.720555:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788587786.720767:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587786.720812:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587786.720888:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587786.720924:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bfc6e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587786.720975:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043888896 00000100:00100000:1.0:1788587786.720981:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043888896 00000100:00100000:1.0:1788587786.721016:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788587786.721024:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043888896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587786.721190:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043888896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587786.721194:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043888896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587786.721197:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000040:00080000:0.0:1788587786.722594:0:11229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788587786.722914:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788587786.723013:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587786.723024:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8397 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587786.723036:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8397 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587787.720306:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587788.239794:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043889024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587788.239886:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587788.239965:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043889024 00000100:00100000:2.0:1788587788.239972:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043889024 00000100:00100000:2.0:1788587788.240241:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788587788.240251:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043889024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587788.240282:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587788.240325:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043889024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587788.240332:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788587788.243730:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788587788.243788:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f485d31180 x1875470043889024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587788.243813:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043889024:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788587788.747278:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788587789.062157:0:11374:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg633-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788587789.257381:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043889152:0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.257446:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587789.257492:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043889664:0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.257520:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587789.257546:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587789.257552:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb25a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043889536:0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.257592:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587789.257621:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043889280:0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.257642:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587789.257657:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4833a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043889792:0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.257674:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587789.257690:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587789.257695:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043889408:0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.257733:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587789.257764:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043889152 00000100:00100000:3.0:1788587789.257771:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043889152 00000100:00100000:3.0:1788587789.257820:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788587789.257860:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043889152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.257908:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043889152:12345-0@lo:400:kworker.0 Request processed in 69us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587789.257915:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788587789.257941:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043889664 00000100:00100000:3.0:1788587789.257945:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043889664 00000100:00100000:3.0:1788587789.257981:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043889280 00000100:00100000:3.0:1788587789.257984:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043889280 00000100:00100000:3.0:1788587789.257997:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043889408 00000100:00100000:3.0:1788587789.258000:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043889408 00000100:00100000:3.0:1788587789.258012:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788587789.258018:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043889664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.258045:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043889664:12345-0@lo:400:kworker.0 Request processed in 27us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587789.258051:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788587789.258060:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788587789.258066:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043889280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.258106:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043889280:12345-0@lo:400:kworker.0 Request processed in 40us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587789.258112:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788587789.258123:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788587789.258129:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043889408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.258164:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043889408:12345-0@lo:400:kworker.0 Request processed in 25us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587789.258170:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788587789.258188:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043889536 00000100:00100000:3.0:1788587789.258197:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043889536 00000100:00100000:3.0:1788587789.258222:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043889792 00000100:00100000:3.0:1788587789.258225:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043889792 00000100:00100000:3.0:1788587789.258246:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788587789.258252:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ea1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043889536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.258284:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ea1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043889536:12345-0@lo:400:kworker.0 Request processed in 33us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587789.258290:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788587789.258414:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788587789.258421:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043889792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.258448:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043889792:12345-0@lo:400:kworker.0 Request processed in 28us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587789.258454:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788587789.258481:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587789.258485:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587789.258514:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043889408:0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.258524:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043889280:0@lo:400:kworker.0 00010000:00080000:3.0:1788587789.258535:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4833a1c00 x1875470043889792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587789.258544:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4833a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043889792:0@lo:400:kworker.0 00010000:00080000:3.0:1788587789.258627:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bb25a300 x1875470043889536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587789.258636:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb25a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043889536:0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.258646:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043889152:0@lo:400:kworker.0 00000100:00100000:3.0:1788587789.258665:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043889664:0@lo:400:kworker.0 00000100:00100000:1.0:1788587789.263094:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf5e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043889920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587789.263222:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587789.269311:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043889920 00000100:00100000:0.0:1788587789.269322:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043889920 00000100:00100000:0.0:1788587789.269376:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788587789.269386:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043889920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587789.269435:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587789.269520:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043889920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (6297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587789.269527:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788587789.272274:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf5e6680 x1875470043889920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587789.272300:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf5e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043889920:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788587789.768501:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587789.795711:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587789.795765:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587789.796395:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587789.804266:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026029952 00000100:00100000:3.0:1788587789.804553:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026029952 00000100:00100000:3.0:1788587789.804680:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 240 00000100:00100000:3.0:1788587789.804691:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2346:x1875470026029952:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587789.804783:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2346:x1875470026029952:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 94us (9088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587789.804791:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 240 00000100:00100000:1.0:1788587789.824285:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026030208 00000100:00100000:1.0:1788587789.824300:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026030208 00000100:00100000:1.0:1788587789.824385:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026030080 00000100:00100000:1.0:1788587789.824389:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026030080 00000100:00100000:1.0:1788587789.824420:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 82 00000100:00100000:1.0:1788587789.824429:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026030208:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587789.824506:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026030208:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 78us (28740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587789.824526:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 82 00000100:00100000:1.0:1788587789.824545:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 83 00000100:00100000:1.0:1788587789.824552:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026030080:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587789.824715:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026030080:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 162us (28328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587789.824722:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 83 00000100:00080000:3.0:1788587789.825252:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788587790.804136:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587791.816238:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788587792.614471:0:11474:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:56:30 (1788587790) === 00010000:00010000:1.0:1788587792.843656:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587792.868640:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587792.868907:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026030464 00000100:00100000:0.0:1788587792.868916:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026030464 00000100:00100000:0.0:1788587792.869006:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00100000:0.0:1788587792.869017:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:9658:x1875470026030464:12345-192.168.206.33@tcp:700:mkdir.0 00000100:00100000:0.0:1788587792.869091:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:9658:x1875470026030464:12345-192.168.206.33@tcp:700:mkdir.0 Request processed in 76us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587792.869099:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00080000:0.0:1788587792.869118:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587792.870560:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587792.870589:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026030336 00000100:00100000:2.0:1788587792.870597:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026030336 00000100:00100000:2.0:1788587792.870645:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 14 00000100:00100000:2.0:1788587792.870654:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2347:x1875470026030336:12345-192.168.206.33@tcp:41:mkdir.0 00000004:00000024:2.0:1788587792.870690:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587792.870878:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2347:x1875470026030336:12345-192.168.206.33@tcp:41:mkdir.0 Request processed in 224us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587792.870885:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 14 00000100:00100000:0.0:1788587792.876551:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587792.877506:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026030720 00000100:00100000:1.0:1788587792.877518:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026030720 00000100:00100000:1.0:1788587792.877589:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 15 00000100:00100000:1.0:1788587792.877600:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:9658:x1875470026030720:12345-192.168.206.33@tcp:36:mkdir.0 00010000:00010000:1.0:1788587792.877655:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587792.877724:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca827f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1059 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587792.877752:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37100) 00010000:00010000:1.0:1788587792.877762:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587792.878136:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668400/0xa13e120d54ca839e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587792.878150:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668400/0xa13e120d54ca839e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587792.878161:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668400/0xa13e120d54ca839e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587792.878203:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca83a5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587792.878212:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca83a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587792.878221:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca83a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587792.879430:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788587792.879445:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668400/0xa13e120d54ca839e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.879454:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668400/0xa13e120d54ca839e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.879461:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668400/0xa13e120d54ca839e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.879476:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481668400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587792.879481:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668400/0xa13e120d54ca839e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.879489:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668400/0xa13e120d54ca839e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.879503:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37000) 00010000:00010000:0.0:1788587792.879506:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587792.879510:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668400/0xa13e120d54ca839e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.879516:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668400/0xa13e120d54ca839e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587792.879534:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a74cfea reply state 00000000cdcbbddb transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca83a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587792.879541:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587792.879634:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:9658:x1875470026030720:12345-192.168.206.33@tcp:36:mkdir.0 Request processed in 2033us (3089us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788587792.879643:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 15 00010000:00010000:0.0:1788587792.882424:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca83a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.882438:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca83a5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.882446:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca83a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.882466:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587792.882471:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca83a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.882478:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca83a5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.882493:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88f48fa37a00) 00010000:00010000:0.0:1788587792.882496:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587792.882500:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca83a5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.882507:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca83a5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587792.896824:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587792.896947:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026030848 00000100:00100000:3.0:1788587792.896956:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026030848 00000100:00100000:3.0:1788587792.897010:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 16 00000100:00100000:3.0:1788587792.897020:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:9659:x1875470026030848:12345-192.168.206.33@tcp:101:chmod.0 00010000:00010000:3.0:1788587792.897039:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587792.897109:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca83ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db10de expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587792.897175:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca83b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587792.897189:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca83b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587792.897202:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca83b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587792.897235:0:7276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587792.897250:0:7276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587792.897287:0:7276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca83b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587792.897314:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca83ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10de expref: 8 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587792.897333:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca83b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10de expref: 7 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587792.897343:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44700) 00010000:00010000:3.0:1788587792.897345:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587792.897349:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed5200, rc 0) 00000100:00100000:3.0:1788587792.897407:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:9659:x1875470026030848:12345-192.168.206.33@tcp:101:chmod.0 Request processed in 388us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587792.897415:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 16 00000100:00100000:1.0:1788587792.900587:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587792.900895:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026031104 00000100:00100000:2.0:1788587792.900905:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026031104 00000100:00100000:2.0:1788587792.900956:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 17 00000100:00100000:2.0:1788587792.900966:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:9659:x1875470026031104:12345-192.168.206.33@tcp:36:chmod.0 00010000:00010000:2.0:1788587792.901019:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587792.901057:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca83b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10de expref: 7 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587792.901077:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44700) 00010000:00010000:2.0:1788587792.901088:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587792.901112:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca83ba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587792.901123:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca83ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587792.901132:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca83ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587792.901414:0:8471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045d8e3b8 reply state 0000000038f3f5a0 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca83ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587792.901424:0:8471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788587792.901431:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788587792.901506:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:9659:x1875470026031104:12345-192.168.206.33@tcp:36:chmod.0 Request processed in 541us (938us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788587792.901513:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 17 00010000:00010000:2.0:1788587792.903543:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca83ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587792.903557:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca83ba lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587792.903564:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca83ba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587792.903570:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159de00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587792.903580:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca83ba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587792.903588:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca83ba lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587792.903603:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f488834f00) 00010000:00010000:2.0:1788587792.903606:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788587792.903611:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca83ba lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587792.903684:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca83ba lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587792.933629:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587792.933794:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026031232 00000100:00100000:0.0:1788587792.933814:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026031232 00000100:00100000:0.0:1788587792.934062:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 18 00000100:00100000:0.0:1788587792.934073:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:9660:x1875470026031232:12345-192.168.206.33@tcp:101:chown.0 00010000:00010000:0.0:1788587792.934095:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587792.934117:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca83c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db10e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.934180:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca83c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.934193:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca83c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.934221:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca83c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587792.934253:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587792.934257:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587792.934291:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca83c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.934314:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca83c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10e5 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.934332:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca83c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10e5 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.934340:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f489033b00) 00010000:00010000:0.0:1788587792.934343:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587792.934347:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a200, rc 0) 00000100:00100000:0.0:1788587792.934410:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:9660:x1875470026031232:12345-192.168.206.33@tcp:101:chown.0 Request processed in 339us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587792.934417:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 18 00000100:00100000:1.0:1788587792.937305:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587792.937394:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026031360 00000100:00100000:0.0:1788587792.937406:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026031360 00000100:00100000:0.0:1788587792.937515:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 19 00000100:00100000:0.0:1788587792.937639:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:9660:x1875470026031360:12345-192.168.206.33@tcp:101:chown.0 00010000:00010000:0.0:1788587792.937660:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587792.937678:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca83cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db10ec expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.937754:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.937766:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.937777:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.937789:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca83dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.937795:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca83dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.937800:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca83dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938432:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca83e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938443:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca83e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938452:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca83e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587792.938485:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587792.938489:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587792.938506:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca83e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938759:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938765:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938772:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938777:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587792.938781:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938788:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938799:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f489033b00) 00010000:00010000:0.0:1788587792.938802:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587792.938816:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938822:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938835:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca83dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938866:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca83dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938872:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca83dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938884:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77ae00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587792.938887:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca83dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938892:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca83dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938900:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88f489033c00) 00010000:00010000:0.0:1788587792.938903:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587792.938906:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca83dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938911:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca83dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938962:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca83cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10ec expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938975:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca83e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10ec expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.938982:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88f489033e00) 00010000:00010000:0.0:1788587792.938984:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587792.938987:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a600, rc 0) 00000100:00100000:0.0:1788587792.939055:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:9660:x1875470026031360:12345-192.168.206.33@tcp:101:chown.0 Request processed in 1485us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587792.939062:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 19 00000100:00100000:2.0:1788587792.944469:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587792.944649:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026031616 00000100:00100000:3.0:1788587792.944659:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026031616 00000100:00100000:3.0:1788587792.944717:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 20 00000100:00100000:3.0:1788587792.944727:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:9660:x1875470026031616:12345-192.168.206.33@tcp:36:chown.0 00010000:00010000:3.0:1788587792.944778:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587792.944814:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca83e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10ec expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587792.944833:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88f489033e00) 00010000:00010000:3.0:1788587792.944885:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587792.944908:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca83eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587792.944933:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca83eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587792.945224:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca83eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587792.979175:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1788587792.979203:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1788587792.979208:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1788587792.979275:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc256ce0 reply state 00000000f65d8514 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca83eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587792.979287:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788587792.979309:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1788587792.979401:0:5841:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788587792.979416:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:9660:x1875470026031616:12345-192.168.206.33@tcp:36:chown.0 Request processed in 34687us (34952us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788587792.979424:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 20 00010000:00010000:0.0:1788587792.979594:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca83eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.979603:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca83eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.979611:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca83eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.979617:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587792.979621:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca83eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.979629:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca83eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.979643:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88f484d44c00) 00010000:00010000:0.0:1788587792.979646:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788587792.979650:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca83eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587792.979656:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca83eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587793.008878:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587793.009087:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026031744 00000100:00100000:0.0:1788587793.009096:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026031744 00000100:00100000:0.0:1788587793.009149:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 21 00000100:00100000:0.0:1788587793.009159:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:9661:x1875470026031744:12345-192.168.206.33@tcp:101:touch.500 00010000:00010000:0.0:1788587793.009182:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587793.009213:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca83f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db10f3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587793.014043:0:5842:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4781us 00010000:00010000:0.0:1788587793.021095:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.021119:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.021133:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.021147:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8400 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.021154:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.021161:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.021486:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8407 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.021494:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.021501:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587793.022012:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587793.022017:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587793.022061:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022081:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022088:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022095:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022101:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587793.022105:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022114:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022127:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f489033b00) 00010000:00010000:0.0:1788587793.022130:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587793.022136:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022141:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca83f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022164:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022170:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8400 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022176:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022185:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587793.022189:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022194:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8400 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022202:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88f489033c00) 00010000:00010000:0.0:1788587793.022205:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587793.022207:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8400 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022213:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8400 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022252:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca83f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10f3 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022266:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10f3 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.022273:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88f489033300) 00010000:00010000:0.0:1788587793.022275:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788587793.022277:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b000, rc 0) 00000100:00100000:0.0:1788587793.022347:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:9661:x1875470026031744:12345-192.168.206.33@tcp:101:touch.500 Request processed in 13188us (13514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587793.022355:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 21 00000100:00100000:1.0:1788587793.033752:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587793.034748:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026032000 00000100:00100000:2.0:1788587793.034762:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026032000 00000100:00100000:2.0:1788587793.034834:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 22 00000100:00100000:2.0:1788587793.034878:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:9661:x1875470026032000:12345-192.168.206.33@tcp:101:touch.500 00010000:00010000:2.0:1788587793.034899:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587793.034919:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca840e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db10fa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.035160:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca8415 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.035176:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca8415 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.035198:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca8415 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.035258:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca841c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.035267:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca841c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.035275:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca841c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587793.035981:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788587793.036229:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.036240:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.036250:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.036283:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca8415 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.036291:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca8415 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.036297:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca8415 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.036303:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587793.036314:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca8415 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.036321:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca8415 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.036332:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88f489033300) 00010000:00010000:2.0:1788587793.036335:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587793.036340:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca8415 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.036346:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca8415 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587793.036360:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009595f802 reply state 0000000063c59be1 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca841c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587793.036368:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788587793.036400:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca840e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10fa expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.036414:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10fa expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.036421:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88f488834c00) 00010000:00010000:2.0:1788587793.036424:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587793.036427:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159ce00, rc 0) 00000100:00100000:2.0:1788587793.036491:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:9661:x1875470026032000:12345-192.168.206.33@tcp:101:touch.500 Request processed in 1648us (2749us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788587793.036500:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 22 00010000:00010000:2.0:1788587793.043405:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca841c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.043422:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca841c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.043431:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca841c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.043438:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159dc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587793.043444:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca841c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.043453:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca841c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.043470:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8d93c3d9 (ffff88f488834f00) 00010000:00010000:2.0:1788587793.043473:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587793.043478:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca841c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.043485:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca841c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587793.059023:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587793.059249:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026032256 00000100:00100000:3.0:1788587793.059259:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026032256 00000100:00100000:3.0:1788587793.059322:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 23 00000100:00100000:3.0:1788587793.059332:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:9661:x1875470026032256:12345-192.168.206.33@tcp:36:touch.500 00010000:00010000:3.0:1788587793.059386:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587793.059410:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10fa expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.059430:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88f488834c00) 00010000:00010000:3.0:1788587793.059441:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587793.059482:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8431 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.059496:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8431 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.059507:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8431 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587793.059767:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3684d2f reply state 000000005082377f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8431 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587793.059777:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587793.060420:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:9661:x1875470026032256:12345-192.168.206.33@tcp:36:touch.500 Request processed in 1086us (1403us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788587793.060428:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 23 00010000:00010000:0.0:1788587793.065266:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8431 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.065294:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8431 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.065301:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8431 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.065320:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587793.065325:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8431 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.065334:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8431 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.065350:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88f484d44800) 00010000:00010000:0.0:1788587793.065353:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587793.065358:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8431 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.065365:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8431 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587793.066741:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587793.066905:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026032384 00000100:00100000:0.0:1788587793.066915:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026032384 00000100:00100000:0.0:1788587793.067108:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 24 00000100:00100000:0.0:1788587793.067120:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:9661:x1875470026032384:12345-192.168.206.33@tcp:101:touch.500 00010000:00010000:0.0:1788587793.067143:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587793.067163:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8438 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1101 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.067351:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8438 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1101 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.067379:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8438 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1101 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.067399:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88f489033c00) 00010000:00010000:0.0:1788587793.067402:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587793.067405:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77ae00, rc 0) 00000100:00100000:0.0:1788587793.067510:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:9661:x1875470026032384:12345-192.168.206.33@tcp:101:touch.500 Request processed in 392us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587793.067517:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 24 00000100:00100000:0.0:1788587793.070127:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587793.070312:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026032512 00000100:00100000:3.0:1788587793.070321:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026032512 00000100:00100000:3.0:1788587793.070365:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 16 00000100:00100000:3.0:1788587793.070373:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2343:x1875470026032512:12345-192.168.206.33@tcp:8:touch.500 00010000:00080000:3.0:1788587793.070405:0:9214:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:3.0:1788587793.070437:0:9214:0:(genops.c:1385:class_connect()) connect: client 5bcb85a0-1673-40ab-a41b-fd8baee9796e, cookie 0xa13e120d54ca843f 00002000:00100000:3.0:1788587793.070448:0:9214:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5bcb85a0-1673-40ab-a41b-fd8baee9796e/ffff88f4bab11000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788587793.070470:0:9214:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788587793.071193:0:9214:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788587793.071362:0:9214:0:(import.c:65:import_set_state_nolock()) ffff88f4bab13800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587793.071445:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2343:x1875470026032512:12345-192.168.206.33@tcp:8:touch.500 Request processed in 1070us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587793.071454:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 16 00000100:00100000:1.0:1788587793.074878:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587793.075421:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026032640 00000100:00100000:3.0:1788587793.075432:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026032640 00000100:00100000:3.0:1788587793.075510:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 17 00000100:00100000:3.0:1788587793.075519:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:0:x1875470026032640:12345-192.168.206.33@tcp:2:touch.500 00000100:00080000:0.0:1788587793.075696:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587793.112427:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:0:x1875470026032640:12345-192.168.206.33@tcp:2:touch.500 Request processed in 36901us (37577us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788587793.112440:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 17 00000001:00080000:0.0:1788587793.113282:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1788587793.113295:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000100:00100000:1.0:1788587793.115482:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587793.115710:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026032896 00000100:00100000:0.0:1788587793.115719:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026032896 00000100:00100000:0.0:1788587793.115831:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 2 00000100:00100000:0.0:1788587793.115880:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:9661:x1875470026032896:12345-192.168.206.33@tcp:35:touch.500 00000100:00100000:0.0:1788587793.116236:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+11:9661:x1875470026032896:12345-192.168.206.33@tcp:35:touch.500 Request processed in 394us (761us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788587793.116244:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 2 00000100:00100000:1.0:1788587793.126672:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587793.126827:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026033024 00000100:00100000:3.0:1788587793.126837:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026033024 00000100:00100000:3.0:1788587793.126931:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 25 00000100:00100000:3.0:1788587793.126966:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+11:9662:x1875470026033024:12345-192.168.206.33@tcp:101:rm.0 00010000:00010000:3.0:1788587793.126990:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587793.127010:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca8446 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1108 expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.127072:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca844d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.127086:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca844d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.127098:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca844d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587793.127131:0:7276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587793.127135:0:7276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587793.127169:0:7276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca844d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.127194:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca8446 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1108 expref: 13 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.127210:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca844d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1108 expref: 12 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.127219:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88f489033300) 00010000:00010000:3.0:1788587793.127222:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587793.127225:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed4a00, rc 0) 00000100:00100000:3.0:1788587793.127284:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+12:9662:x1875470026033024:12345-192.168.206.33@tcp:101:rm.0 Request processed in 321us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587793.127301:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 25 00000100:00100000:1.0:1788587793.131233:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587793.131294:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026033280 00000100:00100000:3.0:1788587793.131302:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026033280 00000100:00100000:3.0:1788587793.131353:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 26 00000100:00100000:3.0:1788587793.131362:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+12:9662:x1875470026033280:12345-192.168.206.33@tcp:101:rm.0 00010000:00010000:3.0:1788587793.131381:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587793.131400:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8454 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db110f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587793.131478:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788587793.131638:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8454 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db110f expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.131655:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f489033b00) 00010000:00010000:3.0:1788587793.131658:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587793.131663:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8454 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db110f expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.131676:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed4c00, rc 0) 00000100:00100000:3.0:1788587793.131738:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:9662:x1875470026033280:12345-192.168.206.33@tcp:101:rm.0 Request processed in 377us (513us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788587793.131746:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 26 00000100:00100000:1.0:1788587793.136698:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587793.136820:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026033408 00000100:00100000:2.0:1788587793.136830:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026033408 00000100:00100000:2.0:1788587793.136913:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 3 00000100:00100000:2.0:1788587793.136923:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:9662:x1875470026033408:12345-192.168.206.33@tcp:37:rm.0 00000100:00100000:0.0:1788587793.147728:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:9662:x1875470026033408:12345-192.168.206.33@tcp:37:rm.0 Request processed in 10796us (11029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587793.147740:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 3 00000100:00100000:1.0:1788587793.152923:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587793.153076:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026033664 00000100:00100000:0.0:1788587793.153085:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026033664 00000100:00100000:0.0:1788587793.153212:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 4 00000100:00100000:0.0:1788587793.153223:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f483774c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:9662:x1875470026033664:12345-192.168.206.33@tcp:35:rm.0 00000100:00100000:0.0:1788587793.153457:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f483774c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:9662:x1875470026033664:12345-192.168.206.33@tcp:35:rm.0 Request processed in 236us (541us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788587793.153464:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 4 00000100:00100000:1.0:1788587793.157737:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587793.158722:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026033920 00000100:00100000:2.0:1788587793.158733:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026033920 00000100:00100000:2.0:1788587793.158796:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 27 00000100:00100000:2.0:1788587793.158833:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:9662:x1875470026033920:12345-192.168.206.33@tcp:101:rm.0 00010000:00010000:2.0:1788587793.158888:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587793.158913:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8462 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1116 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.159193:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8469 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.159208:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8469 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.159219:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8469 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587793.159230:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788587793.159348:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1116 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.159366:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8469 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1116 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.159374:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88f489033300) 00010000:00010000:2.0:1788587793.159378:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587793.159381:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159da00, rc 0) 00000100:00100000:2.0:1788587793.159479:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:9662:x1875470026033920:12345-192.168.206.33@tcp:101:rm.0 Request processed in 647us (1749us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788587793.159485:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 27 00000100:00100000:1.0:1788587793.170492:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587793.170687:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026034048 00000100:00100000:2.0:1788587793.170696:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026034048 00000100:00100000:2.0:1788587793.170759:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 28 00000100:00100000:2.0:1788587793.170768:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:9662:x1875470026034048:12345-192.168.206.33@tcp:41:rm.0 00000004:00000024:2.0:1788587793.171556:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788587793.171757:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:9662:x1875470026034048:12345-192.168.206.33@tcp:41:rm.0 Request processed in 987us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587793.171765:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 28 00000100:00100000:1.0:1788587793.175553:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587793.177249:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026034176 00000100:00100000:2.0:1788587793.177262:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026034176 00000100:00100000:2.0:1788587793.177322:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 29 00000100:00100000:2.0:1788587793.177332:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:9662:x1875470026034176:12345-192.168.206.33@tcp:101:rm.0 00010000:00010000:2.0:1788587793.177351:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587793.177372:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8477 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db111d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177432:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca847e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177446:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca847e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177458:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca847e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177473:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8485 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177480:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177486:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177615:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca848c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177631:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca848c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177638:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca848c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587793.177665:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788587793.177669:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587793.177688:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca848c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177699:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca848c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177708:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca847e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177714:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca847e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177721:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca847e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177727:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587793.177731:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca847e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177738:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca847e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177750:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88f489033300) 00010000:00010000:2.0:1788587793.177753:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587793.177765:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca847e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177771:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca847e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177785:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177791:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8485 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177796:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177801:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587793.177815:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177822:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8485 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177830:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8d93c3d9 (ffff88f488834f00) 00010000:00010000:2.0:1788587793.177832:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587793.177835:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8485 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177882:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8485 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177913:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8477 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db111d expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177936:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca848c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db111d expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.177944:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88f489033c00) 00010000:00010000:2.0:1788587793.177946:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587793.177948:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159de00, rc 0) 00000100:00100000:2.0:1788587793.178009:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+17:9662:x1875470026034176:12345-192.168.206.33@tcp:101:rm.0 Request processed in 678us (2463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587793.178016:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 29 00000100:00100000:1.0:1788587793.181924:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587793.181991:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026034432 00000100:00100000:3.0:1788587793.182014:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026034432 00000100:00100000:3.0:1788587793.182081:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 30 00000100:00100000:3.0:1788587793.182091:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+17:9662:x1875470026034432:12345-192.168.206.33@tcp:36:rm.0 00010000:00010000:3.0:1788587793.182147:0:7276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788587793.182172:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca848c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db111d expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.182193:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8438 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1101 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.182205:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88f489033c00) 00010000:00010000:3.0:1788587793.182220:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca844d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1108 expref: 15 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.182228:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88f489033300) 00010000:00010000:3.0:1788587793.182231:0:7276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587793.182251:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8493 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.182264:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8493 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.182272:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8493 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.182285:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca849a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.182293:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca849a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.182323:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca849a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.182457:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca84a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.182465:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca84a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.182473:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca84a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587793.183236:0:7276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788587793.183445:0:7276:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 240438601068ns, next at 241438401891ns, rc = 0 00010000:00010000:3.0:1788587793.183509:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca84a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.183520:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca84a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.183528:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca84a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.183535:0:7276:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca84a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.183541:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca84a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.183547:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca84a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.183582:0:7276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587793.183601:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca84a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.183607:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca84a1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.183656:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587793.183671:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca84a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.183774:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca84a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.186786:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5200 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587793.186797:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca84a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.186821:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca84a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.191779:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88f484d44a00) 00010000:00010000:2.0:1788587793.191787:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788587793.191799:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca84a8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.191819:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca84a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.191856:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587793.191874:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587793.191877:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587793.192411:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587793.192418:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca84a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.192429:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca84a1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.192445:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88f484d44a00) 00010000:00010000:3.0:1788587793.192448:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788587793.192451:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca84a1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.192458:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca84a1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.192488:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8493 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.192495:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8493 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.192501:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8493 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.192514:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587793.192517:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8493 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.192522:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8493 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.192530:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88f489033300) 00010000:00010000:3.0:1788587793.192533:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587793.192536:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8493 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.192542:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca8493 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587793.192552:0:7276:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070c1bac5 reply state 00000000e13422d6 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca849a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587793.192560:0:7276:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587793.192786:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:9662:x1875470026034432:12345-192.168.206.33@tcp:36:rm.0 Request processed in 10693us (10867us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788587793.192796:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 30 00010000:00010000:2.0:1788587793.200099:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca849a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.200114:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca849a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.200121:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca849a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.200128:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587793.200133:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca849a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.200140:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca849a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.200158:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8d93c3d9 (ffff88f484d44900) 00010000:00010000:2.0:1788587793.200161:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587793.200166:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca849a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.200172:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca849a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587793.201228:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587793.201320:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026034688 00000100:00100000:2.0:1788587793.201329:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026034688 00000100:00100000:2.0:1788587793.201373:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:2.0:1788587793.201382:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:9662:x1875470026034688:12345-192.168.206.33@tcp:35:rm.0 00000100:00100000:2.0:1788587793.201689:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:9662:x1875470026034688:12345-192.168.206.33@tcp:35:rm.0 Request processed in 306us (467us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788587793.201710:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:1.0:1788587793.208701:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587793.208799:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026034944 00000100:00100000:3.0:1788587793.208817:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026034944 00000100:00100000:3.0:1788587793.208901:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 31 00000100:00100000:3.0:1788587793.208912:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:9662:x1875470026034944:12345-192.168.206.33@tcp:36:rm.0 00010000:00010000:3.0:1788587793.208969:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788587793.208996:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8469 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1116 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.209926:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8407 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10f3 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.209940:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88f489033300) 00010000:00010000:3.0:1788587793.209958:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca83c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10e5 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587793.209967:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f489033b00) 00010000:00010000:3.0:1788587793.209973:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587793.210100:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca84af lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.210115:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca84af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.210126:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca84af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.210139:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca84b6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.210146:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca84b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.210152:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca84b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.210405:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca84bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.210413:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca84bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.210421:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca84bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587793.211012:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788587793.211026:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca84bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.211046:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca84bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.211052:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca84bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.211057:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587793.211061:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca84bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.211068:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca84bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.211080:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88f488834800) 00010000:00010000:2.0:1788587793.211082:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788587793.211086:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca84bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.211092:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca84bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.211111:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca84af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.211117:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca84af lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.211123:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca84af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.211128:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159dc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587793.211136:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca84af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.211142:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca84af lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.211151:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f488834f00) 00010000:00010000:2.0:1788587793.211153:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587793.211156:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca84af lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587793.211162:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca84af lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587793.211174:0:8471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000252fef2f reply state 0000000025ff2157 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca84b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587793.211183:0:8471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587793.211280:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:9662:x1875470026034944:12345-192.168.206.33@tcp:36:rm.0 Request processed in 2366us (2584us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788587793.211288:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 31 00010000:00010000:0.0:1788587793.216235:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca84b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.216251:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca84b6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.216258:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca84b6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.216263:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587793.216268:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca84b6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.216275:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca84b6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.216291:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88f488834700) 00010000:00010000:0.0:1788587793.216295:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587793.216310:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca84b6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587793.216316:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca84b6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587793.353568:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043890048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587793.353648:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587793.353868:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043890048 00000100:00100000:1.0:1788587793.353877:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043890048 00000100:00100000:1.0:1788587793.353936:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788587793.353946:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043890048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587793.353978:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587793.354024:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043890048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587793.354031:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788587793.354067:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f485d31500 x1875470043890048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587793.354084:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043890048:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788587793.354310:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788587793.865923:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587794.376507:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043890176:0@lo:400:kworker.0 00000100:00100000:0.0:1788587794.376593:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587794.376650:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043890688:0@lo:400:kworker.0 00000100:00100000:0.0:1788587794.376677:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587794.376702:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587794.376709:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043890560:0@lo:400:kworker.0 00000100:00100000:0.0:1788587794.376735:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587794.376765:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043890304:0@lo:400:kworker.0 00000100:00100000:0.0:1788587794.376791:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587794.376822:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043890816:0@lo:400:kworker.0 00000100:00100000:0.0:1788587794.376860:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587794.376882:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587794.376887:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043890432:0@lo:400:kworker.0 00000100:00100000:0.0:1788587794.376909:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587794.376943:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043890176 00000100:00100000:0.0:1788587794.376950:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043890176 00000100:00100000:0.0:1788587794.376989:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788587794.376998:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043890176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587794.378307:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043890176:12345-0@lo:400:kworker.0 Request processed in 1306us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587794.378318:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788587794.378358:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043890688 00000100:00100000:0.0:1788587794.378363:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043890688 00000100:00100000:0.0:1788587794.378400:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043890304 00000100:00100000:0.0:1788587794.378403:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043890304 00000100:00100000:0.0:1788587794.378415:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043890432 00000100:00100000:0.0:1788587794.378418:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043890432 00000100:00100000:0.0:1788587794.378441:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788587794.378453:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043890688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587794.378493:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043890688:12345-0@lo:400:kworker.0 Request processed in 41us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587794.378498:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788587794.378508:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788587794.378513:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043890304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587794.378536:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043890304:12345-0@lo:400:kworker.0 Request processed in 23us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587794.378541:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788587794.378549:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788587794.378554:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043890432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587794.378574:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043890432:12345-0@lo:400:kworker.0 Request processed in 20us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587794.378579:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788587794.378593:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043890560 00000100:00100000:0.0:1788587794.378595:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043890560 00000100:00100000:0.0:1788587794.378617:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043890816 00000100:00100000:0.0:1788587794.378620:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043890816 00000100:00100000:0.0:1788587794.378639:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788587794.378645:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043890560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587794.378674:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043890560:12345-0@lo:400:kworker.0 Request processed in 29us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587794.378679:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788587794.378689:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788587794.378694:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043890816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587794.378720:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043890816:12345-0@lo:400:kworker.0 Request processed in 26us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587794.378731:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788587794.378759:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587794.378763:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587794.378811:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043890432:0@lo:400:kworker.0 00000100:00100000:0.0:1788587794.378825:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043890304:0@lo:400:kworker.0 00010000:00080000:0.0:1788587794.378837:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f488f18380 x1875470043890816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587794.378863:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043890816:0@lo:400:kworker.0 00000004:00080000:1.0:1788587794.380251:0:7954:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 241635406742ns, next at 242635404647ns, rc = 0 00000100:00100000:1.0:1788587794.380281:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043890944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587794.380327:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587794.380368:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043890944 00000100:00100000:1.0:1788587794.380374:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043890944 00000100:00100000:1.0:1788587794.380409:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788587794.380416:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043890944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587794.380457:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587794.380495:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043890944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587794.380502:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788587794.380538:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f48576f100 x1875470043890944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587794.380554:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043890944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587794.384271:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043890176:0@lo:400:kworker.0 00000100:00100000:0.0:1788587794.384588:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043890688:0@lo:400:kworker.0 00010000:00080000:0.0:1788587794.384621:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f488f19f80 x1875470043890560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587794.384632:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043890560:0@lo:400:kworker.0 00010000:00010000:2.0:1788587794.888975:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587794.924071:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587794.924108:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587794.924135:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587794.924157:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587794.924187:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026035200 00000100:00100000:1.0:1788587794.924196:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026035200 00000100:00100000:1.0:1788587794.924247:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026035456 00000100:00100000:1.0:1788587794.924250:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026035456 00000100:00100000:1.0:1788587794.924270:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 87 00000100:00100000:1.0:1788587794.924278:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:2345:x1875470026035200:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587794.924344:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:2345:x1875470026035200:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 65us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587794.924351:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 87 00000100:00100000:1.0:1788587794.924368:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 88 00000100:00100000:1.0:1788587794.924375:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026035456:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587794.924398:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026035456:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 24us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587794.924404:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 88 00000100:00100000:1.0:1788587794.924428:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026035072 00000100:00100000:1.0:1788587794.924431:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026035072 00000100:00100000:1.0:1788587794.924452:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 242 00000100:00100000:1.0:1788587794.924458:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026035072:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587794.924480:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026035072:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 22us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587794.924486:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 242 00000100:00100000:1.0:1788587794.924512:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026035328 00000100:00100000:1.0:1788587794.924516:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026035328 00000100:00100000:1.0:1788587794.924541:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 44 00000100:00100000:1.0:1788587794.924548:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026035328:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587794.924571:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026035328:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587794.924578:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 44 00000100:00080000:1.0:1788587794.924592:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788587795.917368:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587796.935964:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788587797.391981:0:11625:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788587797.964238:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788587798.071926:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000004:00080000:2.0:1788587798.071954:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788587798.071983:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788587798.071996:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788587798.072255:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043891072:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788587798.072388:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587798.072527:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043891072 00000100:00100000:3.0:1788587798.072535:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043891072 00000100:00100000:3.0:1788587798.072600:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788587798.072610:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043891072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788587798.072634:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788587798.072666:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9baf0f, atime: 0x6a9baf0f, ctime: 0x6a9baf0f, blocks: 0x1 00000100:00080000:2.0:1788587798.072765:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788587798.072810:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f27dad5/0xa13e120d54ca84c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.072827:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=245s v=(0 0) 00010000:00010000:3.0:1788587798.072832:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587798.072838:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f27dad5/0xa13e120d54ca84c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.072893:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f27dad5/0xa13e120d54ca84c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.072904:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f27dad5/0xa13e120d54ca84c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.072912:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f27dad5/0xa13e120d54ca84c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.072983:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788587798.073575:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043891072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 964us (1186us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788587798.073583:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788587798.074714:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88f487a50000/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788587798.074811:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043891072:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788587798.074898:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587798.074911:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f27dad5/0xa13e120d54ca84c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587798.074925:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587798.074930:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f27dad5/0xa13e120d54ca84c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587798.074942:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f27dad5/0xa13e120d54ca84c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587798.074968:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f27dad5/0xa13e120d54ca84c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587798.074977:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f27dad5/0xa13e120d54ca84c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.075117:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587798.075122:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587798.075124:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788587798.413397:0:11675:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1e8a5910 20000000:00000080:0.0:1788587798.413413:0:11675:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88f4b538e800 uarg=0000000000000000 20000000:01000000:0.0:1788587798.413446:0:11675:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788587798.413452:0:11675:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788587798.413457:0:11675:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788587798.414155:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788587798.414316:0:11675:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788587798.419723:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788587798.419800:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788587798.420743:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788587798.420771:0:11675:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788587798.420803:0:11675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.420824:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca8366 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d0 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.420832:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca836d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.420966:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4c159ca00/0xa13e120d54ca837b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8374 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.420988:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4bf77be00/0xa13e120d54ca8389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8382 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.420995:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4bf77ba00/0xa13e120d54ca8397 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca8390 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.421003:0:11675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.421041:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4bf77ba00/0xa13e120d54ca8397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca8390 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.421055:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f4bf77ba00/0xa13e120d54ca8397 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca8390 expref: 18 pid: 5834 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587798.421069:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875470043891200:0@lo:104: 00000100:00100000:3.0:1788587798.421126:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587798.421226:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4bf77be00/0xa13e120d54ca8389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca8382 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.421235:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f4bf77be00/0xa13e120d54ca8389 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca8382 expref: 18 pid: 5835 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587798.421244:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875470043891328:0@lo:104: 00000100:00100000:3.0:1788587798.421265:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587798.422339:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4c159ca00/0xa13e120d54ca837b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca8374 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.422352:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88f4c159ca00/0xa13e120d54ca837b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca8374 expref: 18 pid: 5835 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587798.422375:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875470043891456:0@lo:104: 00000100:00100000:3.0:1788587798.422414:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587798.422433:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043891200 00000100:00100000:1.0:1788587798.422444:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043891200 00010000:00010000:3.0:1788587798.422683:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca836d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.422694:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca836d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d7 expref: 12 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587798.422704:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875470043891584:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587798.422757:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca8366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d0 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.422767:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca8366 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d0 expref: 12 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587798.422786:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875470043891712:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587798.422809:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4935906c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587798.422923:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788587798.422935:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043891328 00000100:00100000:2.0:1788587798.422938:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043891328 00000100:00100000:2.0:1788587798.422956:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043891456 00000100:00100000:2.0:1788587798.422958:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043891456 00000100:00100000:2.0:1788587798.422970:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788587798.422979:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+5:11675:x1875470043891200:12345-0@lo:104: 00010000:00010000:2.0:1788587798.422999:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8397 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587798.423046:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788587798.423053:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+5:11675:x1875470043891200:12345-0@lo:104: Request processed in 75us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587798.423060:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788587798.423076:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587798.423082:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+4:11675:x1875470043891328:12345-0@lo:104: 00010000:00010000:2.0:1788587798.423090:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8389 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587798.423119:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788587798.423124:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+4:11675:x1875470043891328:12345-0@lo:104: Request processed in 42us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587798.423129:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587798.423140:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788587798.423145:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:11675:x1875470043891456:12345-0@lo:104: 00010000:00010000:2.0:1788587798.423153:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca837b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587798.423177:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788587798.423182:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+3:11675:x1875470043891456:12345-0@lo:104: Request processed in 37us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587798.423189:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587798.423578:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875470043891200:0@lo:104: 00000100:00100000:3.0:1788587798.423588:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875470043891328:0@lo:104: 00000100:00100000:3.0:1788587798.423595:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875470043891456:0@lo:104: 00010000:00010000:0.0:1788587798.424516:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788587798.424527:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8397 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.424536:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159cc00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:0.0:1788587798.424540:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca8397 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.424549:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca8397 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587798.424561:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca8397 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587798.424566:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587798.424607:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8397 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.424614:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587798.424640:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8397 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.424648:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f4c159cc00/0xa13e120d54ca8390 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8397 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.424662:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587798.424666:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca8389 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.424671:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669200 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:0.0:1788587798.424673:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca8389 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.424692:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca8389 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587798.424699:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca8389 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587798.424704:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587798.424718:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8389 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.424724:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587798.424739:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8389 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.424746:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481669200/0xa13e120d54ca8382 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca8389 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.424756:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587798.424759:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca837b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.424764:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b200 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:0.0:1788587798.424766:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca837b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.424773:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca837b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587798.424791:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca837b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587798.424802:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587798.424826:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca837b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.424832:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587798.424838:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca837b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.424860:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b200/0xa13e120d54ca8374 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca837b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587798.424873:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043891840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587798.424873:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587798.424874:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587798.424876:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587798.424922:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587798.425090:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:0.0:1788587798.425437:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043891840 00000100:00100000:0.0:1788587798.425505:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043891840 00010000:00010000:0.0:1788587798.425536:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4bf77ba00/0xa13e120d54ca8397 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8390 expref: 19 pid: 5834 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587798.425571:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587798.425579:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043891840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587798.425591:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587798.425597:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4bf77ba00/0xa13e120d54ca8397 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8390 expref: 19 pid: 5834 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.425608:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4bf77ba00/0xa13e120d54ca8397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca8390 expref: 19 pid: 5834 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.425622:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4bf77ba00/0xa13e120d54ca8397 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca8390 expref: 19 pid: 5834 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.425643:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587798.425686:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:3305:x1875470043891840:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587798.425693:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587798.426489:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043891968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587798.426526:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587798.426572:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587798.426578:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043892096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587798.426603:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587798.426629:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587798.426637:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043891968 00000100:00100000:0.0:1788587798.426641:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043891968 00010000:00010000:0.0:1788587798.426661:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4bf77be00/0xa13e120d54ca8389 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8382 expref: 18 pid: 5835 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587798.426682:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043892096 00000100:00100000:0.0:1788587798.426685:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043892096 00010000:00010000:0.0:1788587798.426697:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4c159ca00/0xa13e120d54ca837b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8374 expref: 19 pid: 5835 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587798.426713:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587798.426720:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043891968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587798.426730:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587798.426734:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4bf77be00/0xa13e120d54ca8389 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8382 expref: 19 pid: 5835 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.426744:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4bf77be00/0xa13e120d54ca8389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca8382 expref: 19 pid: 5835 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.426766:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4bf77be00/0xa13e120d54ca8389 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca8382 expref: 19 pid: 5835 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.426786:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587798.426814:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:3302:x1875470043891968:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587798.426821:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587798.426835:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587798.426911:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485c34050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:3302:x1875470043892096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587798.426920:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587798.426924:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4c159ca00/0xa13e120d54ca837b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca8374 expref: 17 pid: 5835 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.426933:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4c159ca00/0xa13e120d54ca837b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca8374 expref: 17 pid: 5835 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.426942:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4c159ca00/0xa13e120d54ca837b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca8374 expref: 17 pid: 5835 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.426950:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587798.426972:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485c34050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:3302:x1875470043892096:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587798.426978:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587798.427029:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043892096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587798.427036:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043891968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587798.428389:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043891840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587798.430443:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587798.430479:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875470043891584:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587798.430493:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875470043891712:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587798.430526:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00010000:00010000:3.0:1788587798.430527:0:11675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587798.430680:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026035584 00000100:00100000:2.0:1788587798.430699:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026035712 00000100:00100000:0.0:1788587798.430706:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026035584 00000100:00100000:2.0:1788587798.430712:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026035712 00010000:00010000:2.0:1788587798.430745:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca836d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d7 expref: 14 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587798.430746:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca8366 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d0 expref: 14 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587798.430806:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 33 00000100:00100000:2.0:1788587798.430816:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+14:2345:x1875470026035712:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587798.430829:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587798.430835:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca836d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d7 expref: 14 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587798.430864:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca836d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d7 expref: 14 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587798.430930:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 34 00000100:00100000:1.0:1788587798.430939:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+14:2344:x1875470026035584:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587798.430947:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587798.430952:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca8366 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d0 expref: 14 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587798.430987:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4bf77b600/0xa13e120d54ca836d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d7 expref: 14 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587798.432053:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca8366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d0 expref: 13 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587798.432075:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca8366 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db10d0 expref: 13 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587798.432091:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587798.432099:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587798.432117:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587798.432125:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587798.432130:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587798.432136:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587798.432141:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4c00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587798.432145:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587798.432153:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587798.432183:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587798.432195:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587798.432265:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:2344:x1875470026035584:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 1326us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587798.432274:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 34 00010000:00010000:3.0:1788587798.432394:0:11675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.432403:0:11675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587798.432409:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed4c00/0xa13e120d54ca84cb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587798.433467:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587798.433518:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:2345:x1875470026035712:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 2699us (2990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587798.433528:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 33 00000100:00100000:2.0:1788587798.473685:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587798.473704:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043892224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587798.473765:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587798.474316:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043892224 00000100:00100000:0.0:1788587798.474325:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043892224 00000100:00100000:0.0:1788587798.474384:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788587798.474393:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043892224:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788587798.474424:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788587798.474426:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587798.474484:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043892224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587798.474491:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788587798.474511:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f485d32680 x1875470043892224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587798.474531:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043892224:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788587798.546470:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1788587798.984414:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587799.497207:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043892352:0@lo:400:kworker.0 00000100:00100000:1.0:1788587799.497281:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587799.497323:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043892864:0@lo:400:kworker.0 00000100:00100000:1.0:1788587799.497346:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587799.497366:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587799.497371:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043892736:0@lo:400:kworker.0 00000100:00100000:1.0:1788587799.497389:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587799.497413:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043892608:0@lo:400:kworker.0 00000100:00100000:1.0:1788587799.497432:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587799.497458:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788587799.497463:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043892480:0@lo:400:kworker.0 00000100:00100000:1.0:1788587799.497482:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587799.497496:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043892992:0@lo:400:kworker.0 00000100:00100000:1.0:1788587799.497511:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587799.497547:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043892736 00000100:00100000:1.0:1788587799.497552:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043892736 00000100:00100000:1.0:1788587799.497585:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043892992 00000100:00100000:1.0:1788587799.497587:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043892992 00000100:00100000:1.0:1788587799.497602:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788587799.497609:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043892736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587799.497648:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043892736:12345-0@lo:400:kworker.0 Request processed in 40us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587799.497655:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788587799.497669:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587799.497675:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043892992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587799.497697:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043892992:12345-0@lo:400:kworker.0 Request processed in 23us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587799.497703:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587799.497716:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043892864 00000100:00100000:1.0:1788587799.497719:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043892864 00000100:00100000:1.0:1788587799.497741:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043892608 00000100:00100000:1.0:1788587799.497743:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043892608 00000100:00100000:1.0:1788587799.497778:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043892480 00000100:00100000:1.0:1788587799.497781:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043892480 00000100:00100000:1.0:1788587799.497795:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788587799.497800:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043892864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587799.497828:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043892864:12345-0@lo:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587799.497834:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788587799.497867:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788587799.497873:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043892608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587799.497899:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043892608:12345-0@lo:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587799.497911:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788587799.497923:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788587799.497928:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043892480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587799.497954:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043892480:12345-0@lo:400:kworker.0 Request processed in 26us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587799.497960:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788587799.498002:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043892480:0@lo:400:kworker.0 00000100:00100000:1.0:1788587799.498012:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788587799.498017:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88f487a50000, transno 4294967300 00000100:00100000:1.0:1788587799.498024:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043892992:0@lo:400:kworker.0 00000100:00100000:1.0:1788587799.498032:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043892608:0@lo:400:kworker.0 00010000:00080000:1.0:1788587799.498060:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f48576df80 x1875470043892736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587799.498070:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043892736:0@lo:400:kworker.0 00000100:00100000:1.0:1788587799.498078:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043892864:0@lo:400:kworker.0 00000100:00100000:0.0:1788587799.498899:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587799.498911:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043893120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587799.498949:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587799.498994:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043892352 00000100:00100000:0.0:1788587799.499000:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043892352 00000100:00100000:0.0:1788587799.499029:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788587799.499036:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:3305:x1875470043892352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587799.499075:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:3305:x1875470043892352:12345-0@lo:400:kworker.0 Request processed in 39us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587799.499081:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788587799.499136:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043892352:0@lo:400:kworker.0 00000100:00100000:3.0:1788587799.499196:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043893120 00000100:00100000:3.0:1788587799.499200:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043893120 00000100:00100000:3.0:1788587799.499228:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788587799.499234:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043893120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587799.499256:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587799.499298:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043893120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587799.499304:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788587799.499330:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043893120:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788587799.499471:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1788587800.008090:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587800.008098:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f4b487a800 from 7 10000000:01000000:0.0:1788587800.008102:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587800.008150:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587800.008177:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587800.008190:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587800.008215:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043893248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587800.008291:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587800.008355:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7ba300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587800.008571:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043893248 00000100:00100000:2.0:1788587800.008578:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043893248 00000100:00100000:2.0:1788587800.008630:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788587800.008645:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:5838:x1875470043893248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587800.008657:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587800.008669:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c159c400/0xa13e120d54ca84d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca84d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587800.008691:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159c400/0xa13e120d54ca84d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca84d2 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587800.008701:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c159c400/0xa13e120d54ca84d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca84d2 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587800.008709:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159c400, rc 0) 00000100:00100000:2.0:1788587800.008757:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043893248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587800.008763:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788587800.008913:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043893248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587800.008928:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca84d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.008937:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca84d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587800.008989:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043893376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.009025:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587800.009062:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4935903c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788587800.009123:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587800.009171:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043893376 00000100:00100000:0.0:1788587800.009176:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043893376 00000100:00100000:0.0:1788587800.009206:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788587800.009212:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043893376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587800.009602:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043893376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 389us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587800.009609:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788587800.009935:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043893376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.009971:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043893504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.010018:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587800.010050:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4935903c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587800.010524:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043893504 00000100:00100000:0.0:1788587800.010530:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043893504 00000100:00100000:0.0:1788587800.010579:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788587800.010587:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043893504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587800.010764:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043893504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587800.010779:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788587800.010913:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043893504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.014715:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:11689:1875470043893632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587800.014811:0:11689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587800.014918:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4935906c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587800.014964:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043893632 00000100:00100000:2.0:1788587800.014971:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043893632 00000100:00100000:2.0:1788587800.015404:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788587800.015417:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:11689:x1875470043893632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587800.015671:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:11689:x1875470043893632:12345-0@lo:502:llog_process_th.0 Request processed in 257us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587800.015679:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788587800.020599:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:11689:1875470043893632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587800.020654:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587800.020668:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587800.020671:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788587800.020677:0:11689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88f4b487a800 00000020:00000080:3.0:1788587800.020680:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788587800.020877:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:11689:1875470043893760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587800.020947:0:11689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587800.020995:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4839180c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587800.021202:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043893760 00000100:00100000:1.0:1788587800.021209:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043893760 00000100:00100000:1.0:1788587800.021261:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788587800.021281:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:11689:x1875470043893760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587800.021491:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:11689:x1875470043893760:12345-0@lo:502:llog_process_th.0 Request processed in 211us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587800.021499:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788587800.023146:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:11689:1875470043893760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587800.023188:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587800.023199:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587800.023201:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788587800.023206:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788587800.024507:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788587800.024533:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587800.024544:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca84d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587800.024563:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca84d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587800.024580:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587800.024586:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f4baee9800 from 7 10000000:01000000:1.0:1788587800.024591:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587800.024634:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587800.024642:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587800.024652:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587800.024673:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043893888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587800.024730:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587800.024785:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4865890c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587800.024883:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043893888 00000100:00100000:2.0:1788587800.024893:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043893888 00000100:00100000:2.0:1788587800.024961:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788587800.024975:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:5838:x1875470043893888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587800.024994:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587800.025025:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c159ca00/0xa13e120d54ca84e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca84e0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587800.025052:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159ca00/0xa13e120d54ca84e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca84e0 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587800.025062:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c159ca00/0xa13e120d54ca84e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca84e0 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587800.025070:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159ca00, rc 0) 00000100:00100000:2.0:1788587800.025259:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043893888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 288us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.025405:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043893888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587800.025426:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca84e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.025513:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca84e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587800.025570:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043894016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.025597:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587800.025620:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4839180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587800.025984:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043894016 00000100:00100000:3.0:1788587800.025990:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043894016 00000100:00100000:3.0:1788587800.026017:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788587800.026023:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043894016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587800.026237:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788587800.031348:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587800.033440:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587800.033981:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043894016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 7954us (8379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587800.033993:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788587800.034025:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026035840 00000100:00100000:3.0:1788587800.034034:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026035840 00000100:00100000:3.0:1788587800.034085:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 251 00000100:00100000:3.0:1788587800.034094:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:2344:x1875470026035840:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587800.034205:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:2344:x1875470026035840:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 111us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.034213:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 251 00000100:00100000:3.0:1788587800.034270:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043894016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.034315:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043894144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.034356:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587800.034384:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4839180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587800.034397:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043894144 00000100:00100000:3.0:1788587800.034407:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043894144 00000100:00100000:3.0:1788587800.034442:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788587800.034449:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043894144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.034588:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043894144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.034595:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788587800.034628:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043894144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.034804:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:11691:1875470043894272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587800.034886:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587800.034909:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043894272 00000100:00100000:3.0:1788587800.034913:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043894272 00000100:00100000:3.0:1788587800.034936:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788587800.034942:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:11691:x1875470043894272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587800.035048:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:11691:x1875470043894272:12345-0@lo:502:llog_process_th.0 Request processed in 105us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.035054:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788587800.035088:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4839180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587800.035101:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:11691:1875470043894272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587800.035120:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587800.035130:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587800.035132:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788587800.035138:0:11691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88f4baee9800 00000020:00000080:3.0:1788587800.035141:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788587800.035210:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:11691:1875470043894400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587800.035242:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587800.035273:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043894400 00000100:00100000:3.0:1788587800.035276:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043894400 00000100:00100000:3.0:1788587800.035298:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788587800.035304:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:11691:x1875470043894400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587800.035409:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:11691:x1875470043894400:12345-0@lo:502:llog_process_th.0 Request processed in 105us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.035416:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788587800.035444:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4839180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587800.035456:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:11691:1875470043894400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587800.035472:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587800.035476:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587800.035477:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788587800.035480:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788587800.035522:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788587800.035538:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587800.035548:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca84e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.035557:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca84e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587800.035566:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788587800.035568:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f488106000 from 7 10000000:01000000:3.0:1788587800.035571:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587800.035593:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.035601:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.035622:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587800.035636:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043894528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.035671:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587800.035685:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bfc6e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587800.035697:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043894528 00000100:00100000:3.0:1788587800.035700:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043894528 00000100:00100000:3.0:1788587800.035723:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788587800.035729:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:5838:x1875470043894528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587800.035737:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587800.035749:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4baed4a00/0xa13e120d54ca84f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca84ee expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.035783:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed4a00/0xa13e120d54ca84f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca84ee expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.035794:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4baed4a00/0xa13e120d54ca84f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca84ee expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.035802:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed4a00, rc 0) 00000100:00100000:3.0:1788587800.035833:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043894528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.035839:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788587800.035896:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043894528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587800.035909:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.035925:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587800.035965:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043894656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.035990:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587800.036008:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bfc6e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587800.036018:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043894656 00000100:00100000:3.0:1788587800.036021:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043894656 00000100:00100000:3.0:1788587800.036042:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788587800.036048:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485ca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043894656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.036238:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485ca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043894656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.036245:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788587800.036274:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043894656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.036297:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043894784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587800.040125:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587800.040174:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587800.042992:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587800.043048:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bfc6e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587800.043073:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043894784 00000100:00100000:3.0:1788587800.043081:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043894784 00000100:00100000:3.0:1788587800.043122:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788587800.043131:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043894784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.043549:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:5838:x1875470043894784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 418us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.043558:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788587800.043624:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:52de7536-38dc-49e6-9b51-4cdaba805a7b:5838:1875470043894784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.043945:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:11693:1875470043894912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587800.043984:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587800.044002:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043894912 00000100:00100000:3.0:1788587800.044005:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043894912 00000100:00100000:3.0:1788587800.044033:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788587800.044041:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:11693:x1875470043894912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587800.044180:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:11693:x1875470043894912:12345-0@lo:502:llog_process_th.0 Request processed in 139us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.044187:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788587800.044226:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bfc6ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587800.044238:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:11693:1875470043894912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587800.044598:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587800.044606:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587800.044609:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788587800.044615:0:11693:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88f488106000 00000020:00000080:3.0:1788587800.044618:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788587800.044989:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:11693:1875470043895040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587800.045027:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587800.045051:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043895040 00000100:00100000:3.0:1788587800.045055:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043895040 00000100:00100000:3.0:1788587800.045083:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788587800.045090:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:11693:x1875470043895040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587800.045217:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:11693:x1875470043895040:12345-0@lo:502:llog_process_th.0 Request processed in 127us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.045224:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788587800.045560:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026035968 00000100:00100000:2.0:1788587800.045565:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026035968 00000100:00100000:2.0:1788587800.045602:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026036224 00000100:00100000:2.0:1788587800.045604:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026036224 00000100:00100000:2.0:1788587800.045625:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 92 00000100:00100000:2.0:1788587800.045632:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2344:x1875470026035968:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587800.045682:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2344:x1875470026035968:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 50us (5568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587800.045688:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 92 00000100:00100000:2.0:1788587800.045702:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 93 00000100:00100000:2.0:1788587800.045709:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2344:x1875470026036224:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587800.045741:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2344:x1875470026036224:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 33us (5566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587800.045747:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 93 00000100:00080000:2.0:1788587800.045892:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587800.045923:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4856eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587800.045941:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:52de7536-38dc-49e6-9b51-4cdaba805a7b:11693:1875470043895040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587800.045966:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587800.045971:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587800.045974:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788587800.045977:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788587800.046104:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788587800.046126:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587800.046135:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587800.046148:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587800.046288:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026036096 00000100:00100000:2.0:1788587800.046294:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026036096 00000100:00100000:2.0:1788587800.046339:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 47 00000100:00100000:2.0:1788587800.046347:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2344:x1875470026036096:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587800.046380:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2344:x1875470026036096:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 35us (12951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587800.046386:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 47 00000100:00080000:2.0:1788587800.046401:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788587800.049415:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788587800.349964:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587800.350132:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026036352 00000100:00100000:3.0:1788587800.350141:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026036352 00000100:00100000:3.0:1788587800.350194:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 260 00000100:00100000:3.0:1788587800.350205:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:5587:x1875470026036352:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587800.350221:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587800.350239:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4baed5c00/0xa13e120d54ca84fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1124 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.350268:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed5c00/0xa13e120d54ca84fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1124 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.350280:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4baed5c00/0xa13e120d54ca84fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1124 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.350289:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed5c00, rc 0) 00000100:00100000:3.0:1788587800.350351:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:5587:x1875470026036352:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 Request processed in 148us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.350358:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 260 00000100:00100000:1.0:1788587800.353151:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587800.353252:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026036480 00000100:00100000:3.0:1788587800.353275:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026036480 00000100:00100000:3.0:1788587800.353345:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 261 00000100:00100000:3.0:1788587800.353358:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:5587:x1875470026036480:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.353716:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:5587:x1875470026036480:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 Request processed in 359us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.353725:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 261 00000100:00100000:0.0:1788587800.356117:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587800.356246:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026036608 00000100:00100000:2.0:1788587800.356259:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026036608 00000100:00100000:2.0:1788587800.356433:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 262 00000100:00100000:2.0:1788587800.356446:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:5587:x1875470026036608:12345-192.168.206.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587800.356743:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:5587:x1875470026036608:12345-192.168.206.33@tcp:503:ll_cfg_requeue.0 Request processed in 298us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587800.356752:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 262 00000100:00100000:1.0:1788587800.360071:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587800.360197:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026036736 00000100:00100000:2.0:1788587800.360211:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026036736 00000100:00100000:2.0:1788587800.360357:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 263 00000100:00100000:2.0:1788587800.360370:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:9932:x1875470026036736:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587800.360758:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:9932:x1875470026036736:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 389us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587800.360778:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 263 00000100:00100000:1.0:1788587800.366923:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587800.367033:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026036864 00000100:00100000:0.0:1788587800.367047:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026036864 00000100:00100000:0.0:1788587800.367138:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 264 00000100:00100000:0.0:1788587800.367150:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:9932:x1875470026036864:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587800.367474:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:9932:x1875470026036864:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 324us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587800.367483:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 264 00000100:00100000:1.0:1788587800.370328:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587800.374714:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026036992 00000100:00100000:3.0:1788587800.374776:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026036992 00000100:00100000:3.0:1788587800.374879:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 265 00000100:00100000:3.0:1788587800.374891:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:5587:x1875470026036992:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587800.374915:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587800.374941:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8503 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db112b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.374978:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db112b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.374991:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db112b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587800.375002:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed5000, rc 0) 00000100:00100000:3.0:1788587800.375097:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:5587:x1875470026036992:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 Request processed in 208us (4781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.375105:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 265 00000100:00100000:1.0:1788587800.377373:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587800.377593:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026037120 00000100:00100000:3.0:1788587800.378109:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026037120 00000100:00100000:3.0:1788587800.378195:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 266 00000100:00100000:3.0:1788587800.378207:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:5587:x1875470026037120:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587800.378912:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:5587:x1875470026037120:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 Request processed in 702us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.378922:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 266 00000100:00100000:1.0:1788587800.385189:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587800.385336:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026037248 00000100:00100000:0.0:1788587800.385351:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026037248 00000100:00100000:0.0:1788587800.385435:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 267 00000100:00100000:0.0:1788587800.385447:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:5587:x1875470026037248:12345-192.168.206.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587800.386000:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:5587:x1875470026037248:12345-192.168.206.33@tcp:503:ll_cfg_requeue.0 Request processed in 552us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587800.386012:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 267 00000100:00100000:1.0:1788587800.398108:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587800.402057:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026037376 00000100:00100000:3.0:1788587800.402079:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026037376 00000100:00100000:3.0:1788587800.402193:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 268 00000100:00100000:3.0:1788587800.402211:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:9935:x1875470026037376:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788587800.404112:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:9935:x1875470026037376:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 1894us (6008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587800.404129:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 268 00000100:00100000:1.0:1788587800.410595:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587800.410785:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026037504 00000100:00100000:0.0:1788587800.410800:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026037504 00000100:00100000:0.0:1788587800.410901:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 269 00000100:00100000:0.0:1788587800.410914:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:9935:x1875470026037504:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587800.411262:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:9935:x1875470026037504:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 347us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587800.411275:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 269 00010000:00010000:0.0:1788587801.032215:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587801.096891:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788587802.057006:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587803.080692:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587803.592535:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587803.596542:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043895168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587803.596639:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587803.596916:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043895168 00000100:00100000:3.0:1788587803.596928:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043895168 00000100:00100000:3.0:1788587803.597135:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788587803.597148:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043895168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587803.597208:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587803.597277:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043895168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587803.597285:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788587803.597333:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788587803.597452:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f485d31c00 x1875470043895168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587803.597477:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043895168:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788587804.109089:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587804.616723:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043895552:0@lo:400:kworker.0 00000100:00100000:1.0:1788587804.616874:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587804.616959:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788587804.616967:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043895424:0@lo:400:kworker.0 00000100:00100000:1.0:1788587804.616992:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587804.617009:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043895936:0@lo:400:kworker.0 00000100:00100000:1.0:1788587804.617036:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587804.617073:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043895552 00000100:00100000:1.0:1788587804.617081:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043895552 00000100:00100000:1.0:1788587804.617137:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043895424 00000100:00100000:1.0:1788587804.617139:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043895424 00000100:00100000:1.0:1788587804.617159:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788587804.617168:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043895552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587804.617225:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043895552:12345-0@lo:400:kworker.0 Request processed in 57us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587804.617232:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788587804.617251:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788587804.617258:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043895424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587804.617294:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043895424:12345-0@lo:400:kworker.0 Request processed in 37us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587804.617301:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788587804.617339:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043895424:0@lo:400:kworker.0 00000100:00100000:1.0:1788587804.617351:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043895552:0@lo:400:kworker.0 00000100:00100000:3.0:1788587804.617521:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043895936 00000100:00100000:3.0:1788587804.617536:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043895936 00000100:00100000:3.0:1788587804.617581:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587804.617589:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043895936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587804.617635:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043895936:12345-0@lo:400:kworker.0 Request processed in 47us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587804.617642:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587804.617665:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043895680:0@lo:400:kworker.0 00000100:00100000:3.0:1788587804.617695:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587804.617719:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788587804.617725:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043895296:0@lo:400:kworker.0 00000100:00100000:3.0:1788587804.617765:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587804.617789:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875470043895808:0@lo:400:kworker.0 00000100:00100000:3.0:1788587804.617827:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587804.617881:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043895296 00000100:00100000:3.0:1788587804.617885:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043895296 00000100:00100000:3.0:1788587804.617913:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788587804.617922:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3304:x1875470043895296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587804.617957:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3304:x1875470043895296:12345-0@lo:400:kworker.0 Request processed in 37us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587804.617963:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788587804.617999:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043895296:0@lo:400:kworker.0 00000100:00100000:3.0:1788587804.618023:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043895936:0@lo:400:kworker.0 00000100:00100000:3.0:1788587804.618065:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043896064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587804.618091:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587804.618197:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043896064 00000100:00100000:0.0:1788587804.618209:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043896064 00000100:00100000:0.0:1788587804.618258:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788587804.618261:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043895808 00000100:00100000:0.0:1788587804.618265:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043896064:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587804.618266:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043895808 00000100:00100000:2.0:1788587804.618299:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00002000:00000024:0.0:1788587804.618300:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587804.618306:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875470043895808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587804.618344:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875470043895808:12345-0@lo:400:kworker.0 Request processed in 39us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587804.618344:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043896064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587804.618351:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788587804.618352:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788587804.618401:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043895680 00000100:00100000:0.0:1788587804.618405:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043895680 00000100:00080000:1.0:1788587804.618429:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587804.618431:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788587804.618434:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587804.618436:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043895680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587804.618483:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043895680:12345-0@lo:400:kworker.0 Request processed in 46us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587804.618491:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788587804.618526:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875470043895808:0@lo:400:kworker.0 00010000:00080000:0.0:1788587804.618541:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f48576fb80 x1875470043895680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587804.618551:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043895680:0@lo:400:kworker.0 00000100:00100000:3.0:1788587804.619329:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043896064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788587805.128350:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587805.152575:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587805.152645:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587805.152683:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587805.152720:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587805.152759:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026037760 00000100:00100000:3.0:1788587805.152774:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026037760 00000100:00100000:1.0:1788587805.152789:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026037888 00000100:00100000:1.0:1788587805.152795:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026037888 00000100:00100000:1.0:1788587805.152889:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 50 00000100:00100000:3.0:1788587805.152897:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026038016 00000100:00100000:3.0:1788587805.152901:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026038016 00000100:00100000:1.0:1788587805.152904:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026037888:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587805.152930:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 97 00000100:00100000:3.0:1788587805.152940:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2344:x1875470026037760:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587805.153029:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2344:x1875470026037760:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 90us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587805.153038:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 97 00000100:00100000:2.0:1788587805.153041:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026037632 00000100:00100000:2.0:1788587805.153049:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026037632 00000100:00100000:3.0:1788587805.153061:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 98 00000100:00100000:3.0:1788587805.153071:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026038016:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587805.153111:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 271 00000100:00100000:2.0:1788587805.153125:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2344:x1875470026037632:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587805.153127:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026038016:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 56us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587805.153138:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 98 00000100:00080000:3.0:1788587805.153159:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587805.153165:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587805.153185:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2344:x1875470026037632:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 63us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587805.153195:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 271 00000100:00100000:1.0:1788587805.153573:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026037888:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 672us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587805.153581:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 50 00010000:00010000:3.0:1788587806.152245:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587807.180746:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587808.204199:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587808.712992:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587808.713014:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043896192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587808.713093:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587808.713300:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043896192 00000100:00100000:2.0:1788587808.713308:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043896192 00000100:00080000:3.0:1788587808.713340:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587808.713358:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788587808.713368:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043896192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587808.713406:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587808.713459:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043896192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587808.713466:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788587808.713710:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f485d31f80 x1875470043896192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587808.713739:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043896192:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788587809.224268:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587809.736379:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043896320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587809.736445:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587809.736575:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043896320 00000100:00100000:0.0:1788587809.736583:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043896320 00000100:00100000:0.0:1788587809.736645:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788587809.736655:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043896320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587809.736686:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587809.736743:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043896320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587809.736762:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788587809.736833:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587809.736885:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043896320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587809.737991:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043896704:0@lo:400:kworker.0 00000100:00100000:0.0:1788587809.737995:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043896448:0@lo:400:kworker.0 00000100:00100000:3.0:1788587809.738062:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043896576:0@lo:400:kworker.0 00000100:00100000:1.0:1788587809.739637:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587809.739703:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587809.739713:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043896832:0@lo:400:kworker.0 00000100:00100000:1.0:1788587809.739770:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587809.739813:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043896832 00000100:00100000:1.0:1788587809.739821:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043896832 00000100:00100000:1.0:1788587809.739879:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788587809.739888:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043896832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587809.739933:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043896832:12345-0@lo:400:kworker.0 Request processed in 46us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587809.739939:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788587809.739976:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f485d32680 x1875470043896832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587809.739989:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043896832:0@lo:400:kworker.0 00000100:00100000:2.0:1788587809.740142:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043896704 00000100:00100000:2.0:1788587809.740147:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043896704 00000100:00100000:2.0:1788587809.740194:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788587809.740202:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043896704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587809.740241:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043896704:12345-0@lo:400:kworker.0 Request processed in 40us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587809.740247:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1788587809.740490:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587809.740513:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043896704:0@lo:400:kworker.0 00000100:00100000:3.0:1788587809.743139:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587809.744307:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043896576 00000100:00100000:2.0:1788587809.744317:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043896576 00000100:00100000:2.0:1788587809.744375:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788587809.744384:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043896576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587809.744463:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043896576:12345-0@lo:400:kworker.0 Request processed in 81us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587809.744470:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788587809.744562:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043896576:0@lo:400:kworker.0 00000100:00100000:0.0:1788587809.744749:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587809.744831:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043896960:0@lo:400:kworker.0 00000100:00100000:0.0:1788587809.744881:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587809.745060:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043896960 00000100:00100000:2.0:1788587809.745076:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043896960 00000100:00080000:1.0:1788587809.745175:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587809.746057:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788587809.746069:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043896960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587809.746140:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043896960:12345-0@lo:400:kworker.0 Request processed in 74us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587809.746146:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788587809.746234:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043896960:0@lo:400:kworker.0 00000100:00100000:3.0:1788587809.750674:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043896448 00000100:00100000:3.0:1788587809.750690:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043896448 00000100:00100000:3.0:1788587809.750764:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788587809.750778:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043896448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587809.750873:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043896448:12345-0@lo:400:kworker.0 Request processed in 101us (6124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587809.750880:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788587809.750944:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043896448:0@lo:400:kworker.0 00010000:00010000:3.0:1788587810.249710:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587810.271928:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587810.271973:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587810.272079:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587810.272110:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587810.272138:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026038144 00000100:00100000:3.0:1788587810.272147:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026038144 00000100:00100000:3.0:1788587810.272191:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 273 00000100:00100000:3.0:1788587810.272200:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026038144:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587810.272276:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026038144:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 76us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587810.272283:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 273 00000100:00100000:3.0:1788587810.272315:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026038400 00000100:00100000:3.0:1788587810.272319:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026038400 00000100:00100000:3.0:1788587810.272369:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 52 00000100:00100000:3.0:1788587810.272376:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026038400:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587810.272404:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026038400:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587810.272410:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 52 00000100:00080000:3.0:1788587810.272517:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587810.274260:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026038272 00000100:00100000:0.0:1788587810.274270:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026038272 00000100:00100000:0.0:1788587810.274339:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026038528 00000100:00100000:0.0:1788587810.274343:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026038528 00000100:00080000:3.0:1788587810.274429:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587810.274489:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 102 00000100:00100000:1.0:1788587810.274501:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026038272:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587810.274587:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026038272:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 85us (2663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587810.274594:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 102 00000100:00100000:0.0:1788587810.275279:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 103 00000100:00100000:0.0:1788587810.275288:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026038528:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587810.275335:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026038528:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 47us (3361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587810.275341:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 103 00000100:00080000:3.0:1788587810.275464:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587811.272666:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587811.339582:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788587812.296301:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587813.321362:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587813.832585:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043897088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587813.832658:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587813.832716:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043897088 00000100:00100000:0.0:1788587813.832723:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043897088 00000100:00100000:0.0:1788587813.832776:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788587813.832785:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043897088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587813.832819:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788587813.833959:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587813.836752:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043897088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3960us (4085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587813.836766:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788587813.839383:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b53adc00 x1875470043897088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587813.839411:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043897088:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788587814.345069:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587814.856552:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043897216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587814.856657:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587814.858503:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043897216 00000100:00100000:0.0:1788587814.858513:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043897216 00000100:00100000:0.0:1788587814.858598:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788587814.858621:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043897216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587814.858654:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587814.858729:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043897216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587814.858737:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788587814.858975:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587814.859151:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043897216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587814.864918:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043897600:0@lo:400:kworker.0 00000100:00100000:1.0:1788587814.864982:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587814.865027:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587814.865033:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043897472:0@lo:400:kworker.0 00000100:00100000:1.0:1788587814.865056:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587814.865224:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043897344:0@lo:400:kworker.0 00000100:00100000:2.0:1788587814.865258:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587814.865289:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043897856:0@lo:400:kworker.0 00000100:00100000:2.0:1788587814.865308:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587814.865325:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587814.865330:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043897728:0@lo:400:kworker.0 00000100:00100000:2.0:1788587814.865349:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587814.865375:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043897600 00000100:00100000:2.0:1788587814.865381:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043897600 00000100:00100000:2.0:1788587814.865422:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043897472 00000100:00100000:2.0:1788587814.865424:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043897472 00000100:00100000:2.0:1788587814.865437:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043897856 00000100:00100000:2.0:1788587814.865439:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043897856 00000100:00100000:2.0:1788587814.865452:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788587814.865458:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043897600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587814.865499:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043897600:12345-0@lo:400:kworker.0 Request processed in 40us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587814.865505:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788587814.865534:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788587814.865540:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043897472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587814.865571:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043897472:12345-0@lo:400:kworker.0 Request processed in 32us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587814.865589:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788587814.865601:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788587814.865606:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043897856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587814.865633:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043897856:12345-0@lo:400:kworker.0 Request processed in 28us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587814.865638:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788587814.865658:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043897728 00000100:00100000:2.0:1788587814.865661:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043897728 00000100:00100000:2.0:1788587814.865681:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788587814.865686:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043897728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587814.865723:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043897728:12345-0@lo:400:kworker.0 Request processed in 37us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587814.865728:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788587814.865763:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f48366e300 x1875470043897728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587814.865775:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043897728:0@lo:400:kworker.0 00000100:00100000:2.0:1788587814.865783:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043897856:0@lo:400:kworker.0 00000100:00100000:2.0:1788587814.865805:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043897472:0@lo:400:kworker.0 00000100:00100000:2.0:1788587814.865812:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043897600:0@lo:400:kworker.0 00000100:00080000:3.0:1788587814.865993:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587814.866059:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043897344 00000100:00100000:1.0:1788587814.866062:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043897344 00000100:00100000:1.0:1788587814.866098:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788587814.866106:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043897344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587814.866149:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043897344:12345-0@lo:400:kworker.0 Request processed in 44us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587814.866155:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788587814.866313:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043897344:0@lo:400:kworker.0 00010000:00010000:3.0:1788587815.368658:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587815.398703:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587815.398755:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587815.399241:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026038784 00000100:00100000:0.0:1788587815.399251:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026038784 00000100:00100000:0.0:1788587815.399330:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 107 00000100:00100000:0.0:1788587815.399341:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026038784:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587815.399407:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026038784:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 69us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587815.399413:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 107 00000100:00080000:1.0:1788587815.399480:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587815.399549:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026038656 00000100:00100000:3.0:1788587815.399553:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026038656 00000100:00100000:3.0:1788587815.399588:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 275 00000100:00100000:3.0:1788587815.399596:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026038656:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587815.399623:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026038656:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 28us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587815.399628:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 275 00000100:00100000:1.0:1788587815.422939:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587815.423080:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026038912 00000100:00100000:3.0:1788587815.423091:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026038912 00000100:00100000:3.0:1788587815.423165:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 19 00000100:00100000:3.0:1788587815.423175:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2343:x1875470026038912:12345-192.168.206.33@tcp:9:kworker.0 00000100:00080000:1.0:1788587815.423256:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1788587815.423306:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca843f 00000100:00080000:3.0:1788587815.423316:0:6694:0:(import.c:65:import_set_state_nolock()) ffff88f4bab13800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788587815.423363:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1788587815.423721:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587815.433357:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+2:2343:x1875470026038912:12345-192.168.206.33@tcp:9:kworker.0 Request processed in 10172us (10414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587815.433370:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 19 00000100:00100000:2.0:1788587815.433817:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587815.434032:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026039040 00000100:00100000:1.0:1788587815.434041:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026039040 00000100:00100000:1.0:1788587815.434100:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 108 00000100:00100000:1.0:1788587815.434108:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b66627bb-533c-4cf5-aca4-320057d76d08+5:2344:x1875470026039040:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587815.434185:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b66627bb-533c-4cf5-aca4-320057d76d08+5:2344:x1875470026039040:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 78us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587815.434191:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 108 00000100:00080000:3.0:1788587815.434408:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587816.392881:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587817.416154:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587818.441700:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587818.952494:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587818.952522:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b53af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043897984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587818.952608:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587818.953368:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043897984 00000100:00100000:0.0:1788587818.953379:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043897984 00000100:00100000:0.0:1788587818.953451:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788587818.953464:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043897984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587818.953507:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587818.953578:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043897984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587818.953586:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788587818.953616:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788587818.953653:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4b53af800 x1875470043897984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587818.953684:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b53af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043897984:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788587819.069288:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000020:00000080:2.0:1788587819.069298:0:7648:0:(genops.c:885:class_export_put()) final put ffff88f4bab11000/5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000020:00000080:1.0:1788587819.071237:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bab11000/5bcb85a0-1673-40ab-a41b-fd8baee9796e for lustre-OST0001 00000020:00000080:1.0:1788587819.071355:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4bab13800 for lustre-OST0001 00010000:00010000:2.0:1788587819.471756:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587819.976697:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043898112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587819.976790:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587819.978699:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043898112 00000100:00100000:1.0:1788587819.978718:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043898112 00000100:00100000:1.0:1788587819.978804:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788587819.978816:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043898112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587819.979977:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587819.980084:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043898112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1267us (3290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587819.980095:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788587819.980141:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587819.981494:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043898112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587819.981629:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043898240:0@lo:400:kworker.0 00000100:00100000:1.0:1788587819.981704:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587819.981745:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875470043898752:0@lo:400:kworker.0 00000100:00100000:1.0:1788587819.981771:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587819.981790:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587819.981795:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043898368:0@lo:400:kworker.0 00000100:00100000:1.0:1788587819.981812:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587819.987793:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043898624:0@lo:400:kworker.0 00000100:00100000:2.0:1788587819.988579:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587819.988643:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587819.988654:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043898496:0@lo:400:kworker.0 00000100:00100000:2.0:1788587819.988708:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587819.988761:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043898624 00000100:00100000:2.0:1788587819.988770:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043898624 00000100:00100000:2.0:1788587819.988827:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788587819.988836:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043898624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587819.989352:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043898624:12345-0@lo:400:kworker.0 Request processed in 514us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587819.989361:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788587819.989395:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043898752 00000100:00100000:2.0:1788587819.989400:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043898752 00000100:00100000:2.0:1788587819.989437:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043898368 00000100:00100000:2.0:1788587819.989441:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043898368 00000100:00100000:2.0:1788587819.989457:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043898496 00000100:00100000:2.0:1788587819.989459:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043898496 00000100:00100000:2.0:1788587819.989475:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788587819.989481:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875470043898752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587819.990040:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043898240 00000100:00100000:1.0:1788587819.990057:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043898240 00000100:00100000:1.0:1788587819.990101:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788587819.990110:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3304:x1875470043898240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587819.990178:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3304:x1875470043898240:12345-0@lo:400:kworker.0 Request processed in 71us (8474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587819.990185:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788587819.990225:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788587819.990233:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043898368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587819.990268:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043898368:12345-0@lo:400:kworker.0 Request processed in 37us (8454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587819.990275:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788587819.990285:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875470043898752:12345-0@lo:400:kworker.0 Request processed in 803us (8512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587819.990289:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788587819.990311:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043898496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587819.990342:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043898496:12345-0@lo:400:kworker.0 Request processed in 32us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587819.992212:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788587819.992332:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043898496:0@lo:400:kworker.0 00010000:00080000:2.0:1788587819.992356:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f485d30380 x1875470043898624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587819.992368:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043898624:0@lo:400:kworker.0 00000100:00100000:1.0:1788587819.994598:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1788587819.994654:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587819.994728:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043898368:0@lo:400:kworker.0 00000100:00100000:1.0:1788587819.994745:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043898240:0@lo:400:kworker.0 00000100:00100000:1.0:1788587819.994759:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875470043898752:0@lo:400:kworker.0 00010000:00010000:3.0:1788587820.488120:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587820.511598:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587820.511656:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587820.511703:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587820.511742:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026039296 00000100:00100000:2.0:1788587820.511755:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026039296 00000100:00100000:2.0:1788587820.511822:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026039424 00000100:00100000:2.0:1788587820.511825:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026039424 00000100:00100000:2.0:1788587820.511878:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 112 00000100:00100000:2.0:1788587820.511891:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2347:x1875470026039296:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587820.511985:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2347:x1875470026039296:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 97us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587820.511994:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 112 00000100:00100000:2.0:1788587820.512015:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 113 00000100:00100000:2.0:1788587820.512022:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+5:2347:x1875470026039424:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587820.512048:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+5:2347:x1875470026039424:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587820.512054:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 113 00000100:00080000:2.0:1788587820.512090:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587820.512697:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026039168 00000100:00100000:0.0:1788587820.512705:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026039168 00000100:00100000:0.0:1788587820.512766:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 277 00000100:00100000:0.0:1788587820.512774:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2347:x1875470026039168:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587820.512819:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2347:x1875470026039168:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 45us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587820.512826:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 277 00010000:00010000:2.0:1788587821.512119:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587821.577578:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788587822.540355:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788587822.663669:0:11858:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:57:00 (1788587820) 00010000:00010000:2.0:1788587823.559967:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587823.992787:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587823.992898:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026039552 00000100:00100000:1.0:1788587823.992908:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026039552 00000100:00100000:1.0:1788587823.992977:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 32 00000100:00100000:1.0:1788587823.992988:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:10203:x1875470026039552:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587823.993021:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587823.993042:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca850a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1132 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587823.993117:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca8511 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587823.993130:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca8511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587823.993144:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca8511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587823.993177:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587823.993181:0:8471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587823.993216:0:8471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca8511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587823.993239:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca850a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1132 expref: 7 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587823.993271:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca8511 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1132 expref: 6 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587823.993280:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37200) 00010000:00010000:1.0:1788587823.993283:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587823.993287:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481668a00, rc 0) 00000100:00100000:1.0:1788587823.993451:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:10203:x1875470026039552:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 464us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587823.993469:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 32 00000100:00080000:2.0:1788587823.993623:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587824.009308:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587824.009399:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026039680 00000100:00100000:0.0:1788587824.009409:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026039680 00000100:00100000:0.0:1788587824.009463:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 33 00000100:00100000:0.0:1788587824.009474:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:10204:x1875470026039680:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587824.009492:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587824.009511:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca8518 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1139 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009573:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca851f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009586:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca851f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009596:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca851f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009611:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8526 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009618:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8526 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009625:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8526 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009877:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca852d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009887:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca852d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009894:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca852d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587824.009921:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587824.009926:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587824.009945:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca852d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009956:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca851f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009962:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca851f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009969:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca851f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009975:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587824.009979:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca851f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009987:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca851f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.009999:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37200) 00010000:00010000:0.0:1788587824.010008:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587824.010014:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca851f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.010020:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca851f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.010034:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8526 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.010040:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8526 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.010046:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8526 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.010051:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587824.010054:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8526 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.010059:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8526 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.010065:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88f489033e00) 00010000:00010000:0.0:1788587824.010068:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587824.010070:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8526 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.010075:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8526 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.010103:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca8518 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1139 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.010127:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca852d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1139 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587824.010135:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88f489033600) 00010000:00010000:0.0:1788587824.010148:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587824.010151:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b800, rc 0) 00000100:00100000:0.0:1788587824.010211:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:10204:x1875470026039680:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 738us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587824.010219:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 33 00000100:00100000:0.0:1788587824.014521:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587824.014918:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026039936 00000100:00100000:3.0:1788587824.014940:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026039936 00000100:00100000:3.0:1788587824.015000:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 34 00000100:00100000:3.0:1788587824.015010:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:10204:x1875470026039936:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587824.015029:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587824.015048:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca8534 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1140 expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015139:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca853b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015160:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca853b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015172:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca853b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015232:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca8542 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015240:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca8542 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015247:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca8542 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015550:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca8549 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015560:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca8549 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015567:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca8549 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587824.015584:0:7276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788587824.015747:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca853b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015755:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca853b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015762:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca853b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015768:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587824.015773:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca853b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015780:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca853b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015792:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88f489033600) 00010000:00010000:3.0:1788587824.015796:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587824.015800:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca853b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.015807:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca853b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.016692:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca8542 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.016714:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca8542 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.016734:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca8542 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.016740:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587824.016743:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca8542 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.016751:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca8542 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.016762:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88f484d44900) 00010000:00010000:3.0:1788587824.016765:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587824.016768:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca8542 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.016774:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca8542 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.017298:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca8534 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1140 expref: 10 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.017313:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca8549 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1140 expref: 9 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587824.017321:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44800) 00010000:00010000:3.0:1788587824.017323:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587824.017326:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed5600, rc 0) 00000100:00100000:3.0:1788587824.027404:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:10204:x1875470026039936:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 12384us (12881us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788587824.027434:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 34 00000100:00100000:3.0:1788587824.035934:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587824.036219:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026040064 00000100:00100000:1.0:1788587824.036228:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026040064 00000100:00100000:1.0:1788587824.036316:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 35 00000100:00100000:1.0:1788587824.036327:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:10204:x1875470026040064:12345-192.168.206.33@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788587824.036445:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:10204:x1875470026040064:12345-192.168.206.33@tcp:59:lhsmtool_posix.0 Request processed in 121us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587824.036458:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 35 00000100:00100000:1.0:1788587824.072312:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587824.072334:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043898880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587824.072399:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587824.072564:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043898880 00000100:00100000:2.0:1788587824.072572:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043898880 00000100:00100000:2.0:1788587824.072773:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788587824.072784:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043898880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587824.072816:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587824.072888:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043898880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587824.072895:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788587824.072932:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f48366e300 x1875470043898880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587824.072948:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043898880:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788587824.075402:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788587824.585208:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587824.650410:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788587825.097206:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043899008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587825.097268:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587825.097340:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043899008 00000100:00100000:3.0:1788587825.097347:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043899008 00000100:00100000:3.0:1788587825.097394:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788587825.097403:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043899008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587825.097518:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587825.097565:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043899008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587825.097572:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788587825.097592:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587825.097605:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf5e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043899520:0@lo:400:kworker.0 00000100:00100000:3.0:1788587825.097631:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587825.097650:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043899264:0@lo:400:kworker.0 00000100:00100000:0.0:1788587825.097678:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587825.097682:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043899008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587825.097697:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788587825.097698:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587825.097703:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f488f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043899136:0@lo:400:kworker.0 00000100:00100000:0.0:1788587825.097703:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043899392:0@lo:400:kworker.0 00000100:00100000:0.0:1788587825.097723:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587825.097725:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587825.097751:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043899264 00000100:00100000:0.0:1788587825.097755:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043899264 00000100:00100000:0.0:1788587825.097781:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043899392 00000100:00100000:0.0:1788587825.097784:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043899392 00000100:00100000:0.0:1788587825.097806:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788587825.097813:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043899264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587825.097823:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bacbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043899648:0@lo:400:kworker.0 00000100:00100000:0.0:1788587825.097867:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043899264:12345-0@lo:400:kworker.0 Request processed in 54us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587825.097873:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788587825.097893:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788587825.097899:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043899392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587825.097928:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043899392:12345-0@lo:400:kworker.0 Request processed in 29us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587825.097935:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788587825.097967:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043899392:0@lo:400:kworker.0 00000100:00100000:0.0:1788587825.097976:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043899264:0@lo:400:kworker.0 00000100:00100000:3.0:1788587825.098127:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587825.098167:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043899520 00000100:00100000:3.0:1788587825.098171:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043899520 00000100:00100000:3.0:1788587825.098200:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788587825.098214:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043899520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587825.098248:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043899520:12345-0@lo:400:kworker.0 Request processed in 35us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587825.098253:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788587825.098271:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043899136 00000100:00100000:3.0:1788587825.098275:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043899136 00000100:00100000:3.0:1788587825.098297:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788587825.098303:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043899136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587825.098330:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043899136:12345-0@lo:400:kworker.0 Request processed in 28us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587825.098336:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788587825.098358:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043899648 00000100:00100000:3.0:1788587825.098361:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043899648 00000100:00100000:3.0:1788587825.098383:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788587825.098388:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043899648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587825.098496:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043899648:12345-0@lo:400:kworker.0 Request processed in 25us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587825.098504:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1788587825.098521:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587825.098541:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f488f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043899136:0@lo:400:kworker.0 00000100:00100000:3.0:1788587825.098551:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bacbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043899648:0@lo:400:kworker.0 00010000:00080000:3.0:1788587825.098564:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf5e5f80 x1875470043899520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587825.098574:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf5e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043899520:0@lo:400:kworker.0 00000100:00100000:2.0:1788587825.551286:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587825.551353:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026040192 00000100:00100000:0.0:1788587825.551361:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026040192 00000100:00100000:0.0:1788587825.551435:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 36 00000100:00100000:0.0:1788587825.551445:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:10246:x1875470026040192:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587825.551464:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587825.551481:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8557 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1147 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551537:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca855e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551551:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca855e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551565:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca855e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551592:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8565 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551600:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8565 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551615:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8565 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551802:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca855e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551810:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca855e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551817:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca855e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551823:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77ba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587825.551827:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca855e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551834:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca855e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551875:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37200) 00010000:00010000:0.0:1788587825.551879:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587825.551883:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca855e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551900:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca855e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551910:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8565 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551915:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8565 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551928:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8565 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551933:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587825.551936:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8565 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551941:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8565 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551949:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88f489033200) 00010000:00010000:0.0:1788587825.551951:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587825.551953:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8565 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551958:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8565 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551987:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8557 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1147 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.551997:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37200) 00010000:00010000:0.0:1788587825.551999:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587825.552002:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8557 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1147 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.552011:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b200, rc 0) 00000100:00100000:0.0:1788587825.552066:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:10246:x1875470026040192:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 621us (790us total) trans 0 rc 301/301 00000100:00100000:0.0:1788587825.552081:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 36 00000100:00080000:1.0:1788587825.552250:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587825.556977:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587825.557081:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026040448 00000100:00100000:3.0:1788587825.557107:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026040448 00000100:00100000:3.0:1788587825.557184:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 37 00000100:00100000:3.0:1788587825.557194:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:10246:x1875470026040448:12345-192.168.206.33@tcp:36:lfs.0 00010000:00010000:3.0:1788587825.557259:0:7276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587825.557289:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca8511 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1132 expref: 9 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.557312:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37200) 00010000:00010000:3.0:1788587825.557324:0:7276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587825.557574:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca856c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.557590:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca856c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.557602:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca856c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.557619:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca8573 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.557627:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca8573 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.557646:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca8573 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587825.558811:0:7276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788587825.558831:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca856c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.558839:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca856c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.558909:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca856c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.558916:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587825.558922:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca856c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.558931:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca856c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.558953:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44900) 00010000:00010000:3.0:1788587825.558957:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587825.558964:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca856c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.558972:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca856c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587825.558999:0:7276:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d255267 reply state 00000000b4ce55a7 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca8573 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587825.559011:0:7276:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587825.559246:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:10246:x1875470026040448:12345-192.168.206.33@tcp:36:lfs.0 Request processed in 2046us (2269us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788587825.559256:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 37 00010000:00010000:2.0:1788587825.561830:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca8573 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.561870:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca8573 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.561886:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca8573 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.561893:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587825.561897:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca8573 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.561905:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca8573 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.561923:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88f484d44c00) 00010000:00010000:2.0:1788587825.561926:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587825.561931:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca8573 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.561937:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca8573 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.609102:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587825.630488:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587825.632266:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026040576 00000100:00100000:3.0:1788587825.632285:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026040576 00000100:00100000:3.0:1788587825.632749:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 38 00000100:00100000:3.0:1788587825.632765:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:10254:x1875470026040576:12345-192.168.206.33@tcp:101:lctl.0 00010000:00010000:3.0:1788587825.632797:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587825.633226:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca857a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db114e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.633327:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca8581 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.633356:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca8581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.633370:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca8581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587825.633416:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587825.633420:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587825.633475:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca8581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.633506:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca857a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db114e expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.633527:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca8581 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db114e expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.633537:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44900) 00010000:00010000:3.0:1788587825.633540:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587825.633544:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed5800, rc 0) 00000100:00100000:3.0:1788587825.633816:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:10254:x1875470026040576:12345-192.168.206.33@tcp:101:lctl.0 Request processed in 1054us (3340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587825.633826:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 38 00000100:00100000:3.0:1788587825.634771:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587825.634814:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587825.634901:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026040704 00000100:00100000:3.0:1788587825.634912:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026040704 00000100:00100000:3.0:1788587825.634959:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 279 00000100:00100000:3.0:1788587825.634970:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026040704:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587825.635240:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026040704:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 271us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587825.635248:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 279 00000100:00100000:3.0:1788587825.635285:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026040832 00000100:00100000:3.0:1788587825.635289:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026040832 00000100:00100000:3.0:1788587825.635340:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 117 00000100:00100000:3.0:1788587825.635347:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026040832:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587825.635379:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026040832:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 33us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587825.635386:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 117 00000100:00080000:3.0:1788587825.635408:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587825.685331:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587825.685571:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026040960 00000100:00100000:2.0:1788587825.685584:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026040960 00000100:00100000:2.0:1788587825.685668:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 39 00000100:00100000:2.0:1788587825.685681:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:10260:x1875470026040960:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:2.0:1788587825.685708:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587825.685736:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8588 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1155 expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.685815:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca858f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.685892:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca858f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.685905:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca858f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.685923:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8596 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.685929:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.685935:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686057:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca859d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686065:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca859d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686072:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca859d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587825.686121:0:7276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788587825.686126:0:7276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587825.686171:0:7276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca859d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686186:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca858f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686202:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca858f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686209:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca858f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686215:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587825.686220:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca858f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686229:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca858f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686243:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44900) 00010000:00010000:2.0:1788587825.686247:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587825.686252:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca858f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686260:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca858f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686276:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686282:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8596 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686288:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8596 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686293:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587825.686302:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8596 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686308:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8596 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686317:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88f488834700) 00010000:00010000:2.0:1788587825.686319:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587825.686323:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8596 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686329:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8596 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686371:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8588 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1155 expref: 12 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686385:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca859d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1155 expref: 11 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.686408:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:2.0:1788587825.686412:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788587825.686414:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159c600, rc 0) 00000100:00100000:2.0:1788587825.686518:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+11:10260:x1875470026040960:12345-192.168.206.33@tcp:101:bash.0 Request processed in 840us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587825.686527:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 39 00000100:00100000:0.0:1788587825.691305:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587825.691419:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026041216 00000100:00100000:3.0:1788587825.691432:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026041216 00000100:00100000:3.0:1788587825.691580:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 40 00000100:00100000:3.0:1788587825.691595:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+11:10260:x1875470026041216:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:3.0:1788587825.691627:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587825.691675:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca85a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db115c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.691876:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca85ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.691915:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca85ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.691931:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca85ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.692156:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca85b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.692179:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca85b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.692193:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca85b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788587825.694231:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788587825.696039:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca85b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.696060:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca85b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.696073:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca85b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.696109:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca85ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.696116:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca85ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.696123:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca85ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.696140:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587825.696145:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca85ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.696152:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca85ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.696165:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:3.0:1788587825.696168:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587825.696173:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca85ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.696179:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5400/0xa13e120d54ca85ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587825.696195:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000435b92fa reply state 000000003b35d950 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca85b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587825.696203:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788587825.696238:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4000/0xa13e120d54ca85a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db115c expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.696252:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca85b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db115c expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.696259:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44400) 00010000:00010000:3.0:1788587825.696261:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587825.696264:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030800, rc 0) 00000100:00100000:3.0:1788587825.696332:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:10260:x1875470026041216:12345-192.168.206.33@tcp:101:bash.0 Request processed in 4742us (5041us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788587825.696347:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 40 00010000:00010000:0.0:1788587825.704429:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca85b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.704451:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca85b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.704460:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca85b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.704467:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587825.704473:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca85b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.704483:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca85b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.704504:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f484d44700) 00010000:00010000:0.0:1788587825.704508:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587825.704514:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca85b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.704522:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5200/0xa13e120d54ca85b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587825.707350:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587825.707575:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026041344 00000100:00100000:2.0:1788587825.707589:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026041344 00000100:00100000:2.0:1788587825.707664:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 20 00000100:00100000:2.0:1788587825.707674:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2343:x1875470026041344:12345-192.168.206.33@tcp:8:bash.0 00010000:00080000:2.0:1788587825.708311:0:9214:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:2.0:1788587825.708356:0:9214:0:(genops.c:1385:class_connect()) connect: client 5bcb85a0-1673-40ab-a41b-fd8baee9796e, cookie 0xa13e120d54ca85c7 00002000:00100000:2.0:1788587825.708373:0:9214:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5bcb85a0-1673-40ab-a41b-fd8baee9796e/ffff88f493ef9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788587825.708388:0:9214:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788587825.708717:0:9214:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788587825.708761:0:9214:0:(import.c:65:import_set_state_nolock()) ffff88f499076000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587825.708877:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2343:x1875470026041344:12345-192.168.206.33@tcp:8:bash.0 Request processed in 1201us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587825.708888:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 20 00000100:00100000:3.0:1788587825.712957:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587825.714150:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026041472 00000100:00100000:0.0:1788587825.714168:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026041472 00000100:00100000:0.0:1788587825.714286:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 21 00000100:00100000:0.0:1788587825.714299:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:0:x1875470026041472:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:0.0:1788587825.714341:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587825.714371:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d13f2e95/0xa13e120d54ca85ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1163 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587825.714406:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587825.714432:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=272s v=(0 0) 00010000:00010000:0.0:1788587825.714438:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587825.714450:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d13f2e95/0xa13e120d54ca85ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1163 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.714477:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d13f2e95/0xa13e120d54ca85ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1163 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.714494:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77ba00, rc 0) 00000100:00100000:0.0:1788587825.714587:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:0:x1875470026041472:12345-192.168.206.33@tcp:101:bash.0 Request processed in 291us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587825.714596:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 21 00000100:00080000:3.0:1788587825.714875:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587825.724686:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587825.725613:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026041600 00000100:00100000:2.0:1788587825.725630:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026041600 00000100:00100000:2.0:1788587825.725724:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 22 00000100:00100000:2.0:1788587825.725745:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:10260:x1875470026041600:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:2.0:1788587825.725768:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587825.725794:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db116a expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.725835:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d13f2e95/0xa13e120d54ca85ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1163 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.725893:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587825.725898:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587825.725905:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587825.726050:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d13f2e95/0xa13e120d54ca85ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1163 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587825.726070:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d13f2e95/0xa13e120d54ca85ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1163 expref: 8 pid: 6693 timeout: 372 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587825.726087:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1875470043899776:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587825.726220:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4ecab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587825.729698:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1875470043899776:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587825.729967:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587825.730019:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159c800, rc 0) 00000100:00100000:1.0:1788587825.730180:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:10260:x1875470026041600:12345-192.168.206.33@tcp:101:bash.0 Request processed in 4445us (5507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587825.730191:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 22 00000100:00100000:3.0:1788587825.734523:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587825.734714:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026041728 00000100:00100000:0.0:1788587825.734727:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026041728 00010000:00010000:0.0:1788587825.734781:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d13f2e95/0xa13e120d54ca85ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1163 expref: 8 pid: 6693 timeout: 372 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587825.734836:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 35 00000100:00100000:0.0:1788587825.734989:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026041728:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587825.735008:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587825.735057:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d13f2e95/0xa13e120d54ca85ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1163 expref: 8 pid: 6693 timeout: 372 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.735073:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d13f2e95/0xa13e120d54ca85ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1163 expref: 8 pid: 6693 timeout: 372 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.735101:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d13f2e95/0xa13e120d54ca85ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1163 expref: 8 pid: 6693 timeout: 372 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.735123:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587825.735200:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587825.735213:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.735226:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.735283:0:6708:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587825.735300:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bacbc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6708:1875470043899904:192.168.206.33@tcp:105: 00000100:00100000:0.0:1788587825.735501:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4856eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587825.742776:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587825.742912:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026041984 00000100:00100000:2.0:1788587825.742941:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026041984 00000100:00100000:2.0:1788587825.743016:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:2.0:1788587825.743029:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:10260:x1875470026041984:12345-192.168.206.33@tcp:35:bash.0 00000100:00100000:2.0:1788587825.743746:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:10260:x1875470026041984:12345-192.168.206.33@tcp:35:bash.0 Request processed in 713us (979us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788587825.743757:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:0.0:1788587825.745522:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bacbc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6708:1875470043899904:192.168.206.33@tcp:105: 00010000:00010000:0.0:1788587825.746185:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587825.746768:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2344:x1875470026041728:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 11775us (12250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587825.746784:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 35 00000100:00100000:1.0:1788587825.816049:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587825.816212:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026042240 00000100:00100000:3.0:1788587825.816226:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026042240 00000100:00100000:3.0:1788587825.816306:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 41 00000100:00100000:3.0:1788587825.816319:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:10270:x1875470026042240:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587825.816351:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587825.816380:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca85dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1171 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587825.816503:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788587825.816679:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca85dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1171 expref: 16 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.816698:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44900) 00010000:00010000:3.0:1788587825.816702:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587825.816708:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca85dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1171 expref: 16 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.816726:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030600, rc 0) 00000100:00100000:3.0:1788587825.816812:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:10270:x1875470026042240:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 496us (778us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788587825.816820:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 41 00000100:00100000:2.0:1788587825.819770:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587825.820295:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026042496 00000100:00100000:3.0:1788587825.820326:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026042496 00000100:00100000:3.0:1788587825.820452:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:3.0:1788587825.820466:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:10270:x1875470026042496:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:3.0:1788587825.820826:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:10270:x1875470026042496:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 363us (1068us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788587825.820834:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:1.0:1788587825.889819:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587825.890175:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026042624 00000100:00100000:2.0:1788587825.890189:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026042624 00000100:00100000:2.0:1788587825.890273:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 42 00000100:00100000:2.0:1788587825.890285:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:10276:x1875470026042624:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:2.0:1788587825.890316:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587825.890352:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca85ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1178 expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.890436:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca85f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.890454:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca85f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.890469:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca85f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587825.890510:0:7276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788587825.890513:0:7276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587825.890538:0:7276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca85f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.890589:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca85ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1178 expref: 18 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.890609:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca85f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1178 expref: 17 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.890618:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:2.0:1788587825.890621:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587825.890624:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159da00, rc 0) 00000100:00100000:2.0:1788587825.890711:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+17:10276:x1875470026042624:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 428us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587825.890719:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 42 00000100:00100000:1.0:1788587825.898154:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587825.898296:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026042880 00000100:00100000:3.0:1788587825.898310:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026042880 00000100:00100000:3.0:1788587825.898383:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 43 00000100:00100000:3.0:1788587825.898397:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+17:10276:x1875470026042880:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587825.898424:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587825.898461:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca85f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db117f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.898591:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca85ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.898609:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca85ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.898623:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca85ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587825.898646:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788587825.898889:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca85f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db117f expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.898914:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca85ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db117f expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.898938:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44400) 00010000:00010000:3.0:1788587825.898941:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587825.898947:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031000, rc 0) 00000100:00100000:3.0:1788587825.899019:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:10276:x1875470026042880:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 625us (888us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788587825.899027:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 43 00000100:00100000:1.0:1788587825.903177:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587825.903443:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026043136 00000100:00100000:0.0:1788587825.903455:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026043136 00000100:00100000:0.0:1788587825.903542:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 44 00000100:00100000:0.0:1788587825.903553:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:10276:x1875470026043136:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587825.903581:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587825.903610:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca860d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1186 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.903742:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8614 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.903757:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.903777:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587825.903791:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788587825.904112:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca860d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1186 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.904136:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1186 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.904146:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44400) 00010000:00010000:0.0:1788587825.904150:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788587825.904154:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b600, rc 0) 00000100:00100000:0.0:1788587825.904220:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:10276:x1875470026043136:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 670us (1058us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788587825.904228:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 44 00000100:00100000:1.0:1788587825.904596:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587825.906477:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026043264 00000100:00100000:2.0:1788587825.906496:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026043264 00000100:00100000:2.0:1788587825.906588:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 2 00000100:00100000:2.0:1788587825.906600:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:2347:x1875470026043264:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587825.906617:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587825.906661:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca85ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db117f expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.906684:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44400) 00010000:00010000:2.0:1788587825.906691:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587825.906764:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:2347:x1875470026043264:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 166us (2168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587825.906772:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 2 00000100:00100000:0.0:1788587825.910043:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587825.910125:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026043392 00000100:00100000:3.0:1788587825.910442:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026043392 00000100:00100000:3.0:1788587825.910520:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 23 00000100:00100000:3.0:1788587825.910530:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2344:x1875470026043392:12345-192.168.206.33@tcp:1:lfs.0 00010000:00010000:3.0:1788587825.910584:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f091106a/0xa13e120d54ca8622 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.910607:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.910616:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788587825.910621:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587825.910626:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f091106a/0xa13e120d54ca8622 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.910683:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.910699:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 7 pid: 6695 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587825.910726:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4806a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875470043900032:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587825.910834:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7bbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587825.919693:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4806a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875470043900032:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587825.919737:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f091106a/0xa13e120d54ca8622 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587825.919793:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587825.919918:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026043520 00000100:00100000:2.0:1788587825.919947:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026043520 00002000:00100000:2.0:1788587825.920003:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff88f4b51c2a00 x1875470026043520/t0(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:386/0 lens 504/0 e 0 to 0 dl 1788587836 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587825.920012:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4b51c2a00 with x1875470026043520 ext(0->12) 00010000:00010000:2.0:1788587825.920020:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 8 pid: 6695 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.920035:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 8 pid: 6695 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587825.920043:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88f4b51c2a00 00000100:00100000:2.0:1788587825.920082:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00100000:2.0:1788587825.920091:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2345:x1875470026043520:12345-192.168.206.33@tcp:4:lfs.0 00000001:00100000:0.0:1788587825.959971:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000100:00100000:1.0:1788587825.960713:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2345:x1875470026043520:12345-192.168.206.33@tcp:4:lfs.0 Request processed in 40616us (40936us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788587825.960729:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 0 00002000:00100000:1.0:1788587825.960742:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff88f4b51c2a00 x1875470026043520/t4294967299(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:386/0 lens 504/448 e 0 to 0 dl 1788587836 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587825.960752:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4b51c2a00 with x1875470026043520 ext(0->12) 00010000:00010000:1.0:1788587825.960764:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 9 pid: 6695 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587825.960782:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 9 pid: 6695 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587825.960800:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88f4b51c2a00 00000100:00100000:2.0:1788587825.963531:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587825.963937:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026043648 00000100:00100000:1.0:1788587825.963947:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026043648 00010000:00010000:1.0:1788587825.963986:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 9 pid: 6695 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587825.964030:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 36 00000100:00100000:1.0:1788587825.964039:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2344:x1875470026043648:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587825.964053:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788587825.964071:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788587825.964074:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788587824 00002000:00010000:1.0:1788587825.964076:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788587824 00002000:00010000:1.0:1788587825.964079:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788587824 00010000:00010000:1.0:1788587825.964085:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 9 pid: 6695 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587825.964098:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 9 pid: 6695 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587825.964121:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e1c7254/0xa13e120d54ca85d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db116a expref: 9 pid: 6695 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587825.964147:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587825.964151:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587825.964156:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f091106a/0xa13e120d54ca8622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587825.964177:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f091106a/0xa13e120d54ca8622 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587825.964252:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587825.964307:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026043648:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 269us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587825.964319:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 36 00010000:00010000:3.0:1788587825.965247:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f091106a/0xa13e120d54ca8622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.965262:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f091106a/0xa13e120d54ca8622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.965391:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f091106a/0xa13e120d54ca8622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.965402:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f091106a/0xa13e120d54ca8622 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.965410:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f091106a/0xa13e120d54ca8622 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.965416:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030600 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587825.965421:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f091106a/0xa13e120d54ca8622 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.965445:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f091106a/0xa13e120d54ca8622 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.965462:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f091106a/0xa13e120d54ca8622 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587825.965469:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f091106a/0xa13e120d54ca8622 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587825.965578:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2344:x1875470026043392:12345-192.168.206.33@tcp:1:lfs.0 Request processed in 55047us (55547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587825.965586:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 23 00000100:00100000:2.0:1788587825.969815:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587825.970148:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026043904 00000100:00100000:0.0:1788587825.970157:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026043904 00000100:00100000:0.0:1788587825.970212:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 8 00000100:00100000:0.0:1788587825.970221:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:10276:x1875470026043904:12345-192.168.206.33@tcp:35:lfs.0 00000004:00010000:0.0:1788587825.970278:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1186 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587825.971349:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788587825.971882:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788587825.974698:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788587825.974800:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.974820:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca85b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db115c expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.974830:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.975045:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca85b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db115c expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.975061:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca85b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db115c expref: 24 pid: 5841 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587825.975077:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bacbca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875470043900160:192.168.206.33@tcp:104: 00000100:00100000:0.0:1788587825.975334:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49912f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587825.976998:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bacbca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875470043900160:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587825.977023:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587825.977523:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587825.977586:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026044032 00000100:00100000:0.0:1788587825.977603:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026044032 00010000:00010000:0.0:1788587825.977646:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca85b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db115c expref: 25 pid: 5841 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587825.977684:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 37 00000100:00100000:0.0:1788587825.977693:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+25:2344:x1875470026044032:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587825.977706:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587825.977713:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca85b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db115c expref: 25 pid: 5841 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.977726:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca85b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db115c expref: 25 pid: 5841 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.977746:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca85b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db115c expref: 25 pid: 5841 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.977762:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44400) 00010000:00010000:0.0:1788587825.977768:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.977777:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.977785:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587825.977823:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587825.978001:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587825.978010:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587825.978035:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:2344:x1875470026044032:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 341us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587825.978051:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 37 00000001:00080000:1.0:1788587825.978123:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788587825.978344:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788587825.978457:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b51c3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875470043900288:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788587825.978500:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587825.978525:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f485cebe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587825.978583:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043900288 00000100:00100000:3.0:1788587825.978589:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043900288 00000100:00100000:3.0:1788587825.978629:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587825.978649:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875470043900288:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788587825.978719:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875470043900288:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 71us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587825.978726:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587825.978765:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b51c3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875470043900288:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788587825.979349:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788587825.979402:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4806a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875470043900416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788587825.979446:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587825.979480:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7bb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587825.981367:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043900416 00000100:00100000:1.0:1788587825.981389:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043900416 00000100:00100000:1.0:1788587825.981427:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587825.981436:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875470043900416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788587825.981694:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875470043900416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 258us (2245us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788587825.981702:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587825.981748:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4806a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875470043900416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788587825.981825:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788587825.982015:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.982026:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.982033:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.982039:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587825.982043:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.982051:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.982068:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44400) 00010000:00010000:3.0:1788587825.982072:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788587825.982076:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.982083:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8629 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788587825.982262:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788587825.982465:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788587825.982476:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 273237632859ns, next at 274237631249ns, rc = 0 00000001:00080000:3.0:1788587825.982482:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788587825.982522:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44400) 00010000:00010000:3.0:1788587825.982525:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788587825.982532:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8614 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1186 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587825.982628:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+27:10276:x1875470026043904:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 12407us (12821us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788587825.982647:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 8 00000020:00080000:3.0:1788587825.982652:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788587825.987751:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587825.987829:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026044160 00000100:00100000:3.0:1788587825.987839:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026044160 00000100:00100000:3.0:1788587825.987932:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 45 00000100:00100000:3.0:1788587825.987942:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+27:10276:x1875470026044160:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587825.987963:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587825.987985:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca8630 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db118d expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.988037:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca8630 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db118d expref: 28 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.988051:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca8630 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db118d expref: 28 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587825.988071:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:3.0:1788587825.988074:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587825.988077:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031a00, rc 0) 00000100:00100000:3.0:1788587825.988133:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+28:10276:x1875470026044160:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 192us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587825.988157:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 45 00000100:00100000:0.0:1788587825.993907:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587825.994045:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026044416 00000100:00100000:3.0:1788587825.994055:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026044416 00000100:00100000:3.0:1788587825.994100:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00100000:3.0:1788587825.994110:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f483777c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+28:10276:x1875470026044416:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:3.0:1788587825.994313:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f483777c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+29:10276:x1875470026044416:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 203us (421us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788587825.994321:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00100000:1.0:1788587826.079764:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587826.080922:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026044672 00000100:00100000:3.0:1788587826.080941:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026044672 00000100:00100000:3.0:1788587826.081131:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 46 00000100:00100000:3.0:1788587826.081247:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+29:10286:x1875470026044672:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587826.081279:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587826.081307:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8637 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1194 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587826.081468:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788587826.081628:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8637 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1194 expref: 31 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.082995:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44900) 00010000:00010000:3.0:1788587826.083001:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587826.083012:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8637 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1194 expref: 31 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.083036:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031800, rc 0) 00000100:00100000:3.0:1788587826.083227:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:10286:x1875470026044672:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 2082us (3475us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788587826.083238:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 46 00000100:00100000:2.0:1788587826.086536:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587826.086798:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026044800 00000100:00100000:0.0:1788587826.086811:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026044800 00000100:00100000:0.0:1788587826.087000:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 47 00000100:00100000:0.0:1788587826.087013:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:10286:x1875470026044800:12345-192.168.206.33@tcp:34:lfs.0 00010000:00010000:0.0:1788587826.087108:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8645 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087216:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8645 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087232:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8645 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087251:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca864c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087258:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca864c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087264:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca864c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087368:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8653 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087376:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087382:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587826.087590:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087604:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8645 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087611:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8645 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087618:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8645 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087623:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587826.087627:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8645 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087646:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8645 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087658:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:0.0:1788587826.087661:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587826.087667:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8645 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087674:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8645 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087693:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca864c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087699:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca864c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087713:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca864c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087718:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587826.087721:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca864c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087726:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca864c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087732:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f489033400) 00010000:00010000:0.0:1788587826.087734:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587826.087737:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca864c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087742:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca864c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087757:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087763:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8653 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087767:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087772:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587826.087775:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087790:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8653 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087798:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:0.0:1788587826.087800:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587826.087804:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8653 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.087810:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8653 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587826.087991:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:10286:x1875470026044800:12345-192.168.206.33@tcp:34:lfs.0 Request processed in 978us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587826.088001:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 47 00000100:00100000:0.0:1788587826.091776:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587826.091933:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026045056 00000100:00100000:3.0:1788587826.091959:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026045056 00000100:00100000:0.0:1788587826.092117:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:0.0:1788587826.092132:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:10286:x1875470026045056:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:0.0:1788587826.092434:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:10286:x1875470026045056:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 305us (670us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788587826.092442:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:1.0:1788587826.132177:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587826.134132:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026045312 00000100:00100000:3.0:1788587826.134152:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026045312 00000100:00100000:2.0:1788587826.137038:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 48 00000100:00100000:2.0:1788587826.137063:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:10289:x1875470026045312:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:2.0:1788587826.137096:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587826.137123:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca865a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db119b expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.137258:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8661 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.137285:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.137298:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.137316:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.137322:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.137329:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.137495:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca866f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.137505:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca866f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.137512:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca866f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587826.137524:0:7276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788587826.137654:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.137663:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8661 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.138524:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8661 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.138538:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587826.138543:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8661 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.138552:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8661 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.138570:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:2.0:1788587826.138574:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587826.138579:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8661 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.138586:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8661 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.138605:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.138612:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8668 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.138619:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.138624:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587826.138628:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.138667:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8668 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.138676:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f488834800) 00010000:00010000:2.0:1788587826.138830:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587826.138835:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8668 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.138966:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8668 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.139061:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca865a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db119b expref: 34 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.139078:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca866f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db119b expref: 33 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.139086:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:2.0:1788587826.139088:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587826.139091:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159dc00, rc 0) 00000100:00100000:2.0:1788587826.139193:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:10289:x1875470026045312:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 2132us (7022us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788587826.139203:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 48 00000100:00100000:1.0:1788587826.144046:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587826.144149:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026045440 00000100:00100000:3.0:1788587826.144158:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026045440 00000100:00100000:3.0:1788587826.144205:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 49 00000100:00100000:3.0:1788587826.144215:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:10289:x1875470026045440:12345-192.168.206.33@tcp:54:lfs.0 00010000:00010000:3.0:1788587826.144276:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca867d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.144293:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca867d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.144305:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca867d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.144330:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca867d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.144337:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca867d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.144344:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca867d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.144350:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587826.144354:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca867d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.144374:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca867d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.144386:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:3.0:1788587826.144389:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587826.144393:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca867d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.144399:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca867d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587826.144468:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:10289:x1875470026045440:12345-192.168.206.33@tcp:54:lfs.0 Request processed in 255us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587826.144476:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 49 00000100:00100000:0.0:1788587826.147457:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587826.147572:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026045696 00000100:00100000:1.0:1788587826.147584:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026045696 00000100:00100000:1.0:1788587826.147660:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:1.0:1788587826.147673:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:10289:x1875470026045696:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:1.0:1788587826.148032:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+34:10289:x1875470026045696:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 360us (586us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788587826.148041:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:1.0:1788587826.383917:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587826.383966:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026045952 00000100:00100000:0.0:1788587826.384179:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026045952 00000100:00100000:0.0:1788587826.384309:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 50 00000100:00100000:0.0:1788587826.384333:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+34:10321:x1875470026045952:12345-192.168.206.33@tcp:101:cat.0 00010000:00010000:0.0:1788587826.384364:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587826.384419:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8684 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db11a2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.384554:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca868b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.384572:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca868b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.384586:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca868b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587826.384599:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788587826.384788:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8684 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11a2 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.384813:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca868b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11a2 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.384823:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:0.0:1788587826.384827:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587826.384831:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a200, rc 0) 00000100:00100000:0.0:1788587826.384959:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:10321:x1875470026045952:12345-192.168.206.33@tcp:101:cat.0 Request processed in 639us (1055us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788587826.384967:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 50 00000100:00100000:1.0:1788587826.388382:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587826.388663:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026046080 00000100:00100000:2.0:1788587826.388678:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026046080 00000100:00100000:1.0:1788587826.388784:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587826.388888:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026046336 00000100:00100000:3.0:1788587826.388903:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026046336 00000100:00100000:3.0:1788587826.388944:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 12 00000100:00100000:3.0:1788587826.388956:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:10321:x1875470026046336:12345-192.168.206.33@tcp:35:cat.0 00000100:00100000:2.0:1788587826.389092:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 3 00000100:00100000:2.0:1788587826.389103:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d69850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:2345:x1875470026046080:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587826.389136:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587826.389166:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca868b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11a2 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.389189:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:2.0:1788587826.389195:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587826.389326:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:10321:x1875470026046336:12345-192.168.206.33@tcp:35:cat.0 Request processed in 371us (542us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788587826.389337:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 12 00000100:00100000:2.0:1788587826.389339:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d69850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:2345:x1875470026046080:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 234us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587826.389351:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 3 00000100:00100000:1.0:1788587826.457978:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587826.458344:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026046592 00000100:00100000:2.0:1788587826.458357:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026046592 00000100:00100000:2.0:1788587826.458449:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 51 00000100:00100000:2.0:1788587826.458462:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:10327:x1875470026046592:12345-192.168.206.33@tcp:101:dd.0 00010000:00010000:2.0:1788587826.458493:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587826.458497:0:7276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788587826.458528:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca85f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1178 expref: 36 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.458551:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:2.0:1788587826.458557:0:7276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587826.458573:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8699 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db11a9 expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.458947:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.458966:0:7276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca866f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db119b expref: 36 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.458992:0:7276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.459032:0:7276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca866f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db119b expref: 36 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.459118:0:7276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca866f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db119b expref: 36 pid: 7276 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587826.459144:0:7276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7276:1875470043900544:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587826.459270:0:7276:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4ecad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587826.462503:0:7276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7276:1875470043900544:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587826.462548:0:7276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587826.462579:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587826.462671:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026046720 00000100:00100000:0.0:1788587826.462680:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026046720 00010000:00010000:0.0:1788587826.462724:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca866f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db119b expref: 37 pid: 7276 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587826.462791:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 38 00000100:00100000:0.0:1788587826.462802:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:2345:x1875470026046720:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587826.462819:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587826.462828:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca866f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db119b expref: 37 pid: 7276 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.462882:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca866f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db119b expref: 37 pid: 7276 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.462910:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca866f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db119b expref: 37 pid: 7276 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.462929:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:0.0:1788587826.462934:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.462945:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.462954:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.462990:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587826.463049:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:2345:x1875470026046720:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 248us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587826.463057:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 38 00010000:00010000:3.0:1788587826.463705:0:7276:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.463717:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587826.463743:0:7276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788587826.464067:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8699 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11a9 expref: 37 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.465470:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11a9 expref: 36 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.465484:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:3.0:1788587826.465487:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788587826.465492:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159ce00, rc 0) 00000100:00100000:3.0:1788587826.465571:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:10327:x1875470026046592:12345-192.168.206.33@tcp:101:dd.0 Request processed in 7112us (7608us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788587826.465581:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 51 00000100:00100000:1.0:1788587826.471217:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587826.471323:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026046976 00000100:00100000:0.0:1788587826.471352:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026046976 00000100:00100000:0.0:1788587826.471728:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 52 00000100:00100000:0.0:1788587826.471742:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:10327:x1875470026046976:12345-192.168.206.33@tcp:36:dd.0 00010000:00010000:0.0:1788587826.472202:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.472226:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.472240:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587826.472297:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788587826.472322:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084ff78bd reply state 000000002ee1db44 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587826.472331:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587826.472655:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+39:10327:x1875470026046976:12345-192.168.206.33@tcp:36:dd.0 Request processed in 913us (1582us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788587826.472664:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 52 00000020:00080000:0.0:1788587826.472671:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788587826.475943:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.475964:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.475972:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.475978:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587826.475984:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.476017:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.476039:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:2.0:1788587826.476042:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587826.476049:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.476056:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.634406:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587826.661224:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587826.661368:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026047104 00000100:00100000:0.0:1788587826.661377:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026047104 00000100:00100000:0.0:1788587826.661441:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 53 00000100:00100000:0.0:1788587826.661460:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+38:10341:x1875470026047104:12345-192.168.206.33@tcp:101:stat.0 00010000:00010000:0.0:1788587826.661482:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587826.661771:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca86b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db11b0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.661865:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.661893:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.661905:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.661954:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.661963:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.661971:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.662051:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca86ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.662063:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11a9 expref: 39 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.662071:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca86ca lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.662101:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11a9 expref: 39 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.662115:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11a9 expref: 39 pid: 7276 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587826.662202:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bacbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043900672:192.168.206.33@tcp:104: 00000100:00100000:0.0:1788587826.662302:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49912f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587826.665917:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bacbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043900672:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587826.665945:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca86ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587826.667892:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587826.668070:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026047360 00000100:00100000:0.0:1788587826.668079:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026047360 00000100:00100000:0.0:1788587826.668141:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 13 00000100:00100000:0.0:1788587826.668152:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+40:5584:x1875470026047360:12345-192.168.206.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788587826.668481:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+41:5584:x1875470026047360:12345-192.168.206.33@tcp:35:ldlm_bl.0 Request processed in 330us (595us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788587826.668826:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 13 00000100:00100000:1.0:1788587826.671927:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587826.672039:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026047488 00000100:00100000:2.0:1788587826.672048:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026047488 00010000:00010000:2.0:1788587826.672081:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11a9 expref: 41 pid: 7276 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587826.672209:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 39 00000100:00100000:2.0:1788587826.672220:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+41:2345:x1875470026047488:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587826.672234:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587826.672241:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11a9 expref: 41 pid: 7276 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.672254:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11a9 expref: 41 pid: 7276 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.672274:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca86a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11a9 expref: 41 pid: 7276 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.672303:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:2.0:1788587826.672308:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca86ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.672318:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca86ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.672326:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca86ca lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587826.672358:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587826.672666:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+40:2345:x1875470026047488:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 445us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587826.672674:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 39 00010000:00010000:0.0:1788587826.673564:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca86ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673576:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca86ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587826.673621:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788587826.673625:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587826.673677:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca86ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673690:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca86ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673715:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673722:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673729:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673734:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587826.673739:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673746:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673759:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:0.0:1788587826.673762:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587826.673766:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673771:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673785:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673791:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673796:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673807:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587826.673810:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673816:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673825:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f489033400) 00010000:00010000:0.0:1788587826.673827:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587826.673830:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673836:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673919:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca86b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11b0 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673934:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca86ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11b0 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.673941:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:0.0:1788587826.673944:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587826.673946:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a200, rc 0) 00000100:00100000:0.0:1788587826.673991:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+39:10341:x1875470026047104:12345-192.168.206.33@tcp:101:stat.0 Request processed in 12534us (12777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587826.673999:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 53 00000100:00100000:1.0:1788587826.739600:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587826.739685:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026047744 00000100:00100000:3.0:1788587826.739694:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026047744 00000100:00100000:3.0:1788587826.739749:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 54 00000100:00100000:3.0:1788587826.739758:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+39:10347:x1875470026047744:12345-192.168.206.33@tcp:36:truncate.0 00010000:00010000:3.0:1788587826.739804:0:7276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587826.739827:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca86ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11b0 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.739880:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:3.0:1788587826.739896:0:7276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587826.740073:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca86d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.740087:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca86d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.740112:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca86d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788587826.740156:0:7276:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788587826.740175:0:7276:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000846fbe82 reply state 0000000059a843cd transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca86d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587826.740183:0:7276:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587826.740419:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+41:10347:x1875470026047744:12345-192.168.206.33@tcp:36:truncate.0 Request processed in 660us (825us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788587826.740426:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 54 00000020:00080000:3.0:1788587826.740431:0:7276:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788587826.741676:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca86d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587826.741688:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca86d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587826.741695:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca86d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587826.741702:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587826.741717:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca86d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587826.741725:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca86d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587826.741737:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:1.0:1788587826.741740:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587826.741744:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca86d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587826.741750:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca86d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587826.879242:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587826.879447:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026047872 00000100:00100000:0.0:1788587826.879479:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026047872 00000100:00100000:0.0:1788587826.879553:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 55 00000100:00100000:0.0:1788587826.879563:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+40:10361:x1875470026047872:12345-192.168.206.33@tcp:101:stat.0 00010000:00010000:0.0:1788587826.879587:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587826.879616:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca86d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db11b7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.879704:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.879718:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.879732:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.879746:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.879753:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.879760:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.879871:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca86ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.879880:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca86ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.879887:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca86ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587826.879926:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788587826.879930:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587826.879949:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca86ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.879961:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca86ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.879970:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.879976:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.879984:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.879990:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587826.879995:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.880003:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.880014:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:0.0:1788587826.880017:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587826.880022:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.880029:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca86df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.880054:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.880060:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.880066:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.880072:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587826.880075:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.880082:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.880091:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f489033400) 00010000:00010000:0.0:1788587826.880093:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587826.880097:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.880103:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca86e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.880133:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca86d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11b7 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.880146:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca86ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11b7 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587826.880165:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:0.0:1788587826.880168:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587826.880171:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b000, rc 0) 00000100:00100000:0.0:1788587826.880430:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+41:10361:x1875470026047872:12345-192.168.206.33@tcp:101:stat.0 Request processed in 867us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587826.880438:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 55 00000100:00100000:0.0:1788587826.956500:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587826.956681:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026048128 00000100:00100000:3.0:1788587826.956695:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026048128 00000100:00100000:3.0:1788587826.956775:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 56 00000100:00100000:3.0:1788587826.956787:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+41:10371:x1875470026048128:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587826.956813:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587826.956872:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca86f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db11be expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587826.957111:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788587826.957337:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca86f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11be expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.957354:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44900) 00010000:00010000:3.0:1788587826.957358:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587826.957363:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca86f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11be expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587826.957403:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031800, rc 0) 00000100:00100000:3.0:1788587826.957825:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+42:10371:x1875470026048128:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 1036us (1336us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788587826.957835:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 56 00000100:00100000:1.0:1788587826.961744:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587826.961894:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026048384 00000100:00100000:2.0:1788587826.961908:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026048384 00000100:00100000:2.0:1788587826.961969:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 14 00000100:00100000:2.0:1788587826.961980:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+42:10371:x1875470026048384:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:2.0:1788587826.962318:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+43:10371:x1875470026048384:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 339us (592us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788587826.962328:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 14 00000100:00100000:1.0:1788587827.011359:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587827.011470:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026048640 00000100:00100000:2.0:1788587827.011484:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026048640 00000100:00100000:2.0:1788587827.011571:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 57 00000100:00100000:2.0:1788587827.011583:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+43:10377:x1875470026048640:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:2.0:1788587827.011614:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587827.011668:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8702 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db11c5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.011804:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.011821:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca86ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11b7 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.011831:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.011909:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca86ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11b7 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.012214:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca86ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11b7 expref: 44 pid: 5841 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587827.012232:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043900800:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587827.012359:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4ecad80 going to sleep for 11 seconds 00000100:00080000:3.0:1788587827.012439:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587827.020711:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587827.020794:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026048768 00000100:00100000:0.0:1788587827.020806:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026048768 00010000:00010000:0.0:1788587827.020887:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca86ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11b7 expref: 45 pid: 5841 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587827.020938:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 40 00000100:00100000:0.0:1788587827.020950:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+45:2344:x1875470026048768:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587827.020968:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587827.020976:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca86ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11b7 expref: 45 pid: 5841 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.020991:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca86ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11b7 expref: 45 pid: 5841 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.021020:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:0.0:1788587827.021027:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.021037:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.021065:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.021089:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587827.021177:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+45:2344:x1875470026048768:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 229us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587827.021185:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 40 00010000:00010000:3.0:1788587827.021621:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca86ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11b7 expref: 44 pid: 5841 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587827.021655:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043900800:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587827.021684:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.021694:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.021700:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587827.021725:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788587827.021963:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8702 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11c5 expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.021981:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11c5 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.021991:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:3.0:1788587827.021994:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788587827.022008:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159da00, rc 0) 00000100:00100000:3.0:1788587827.022057:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+44:10377:x1875470026048640:12345-192.168.206.33@tcp:101:bash.0 Request processed in 10477us (10712us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788587827.022066:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 57 00000100:00100000:1.0:1788587827.027597:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587827.028006:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026049024 00000100:00100000:0.0:1788587827.028144:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026049024 00000100:00100000:0.0:1788587827.028283:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 58 00000100:00100000:0.0:1788587827.028295:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+44:10377:x1875470026049024:12345-192.168.206.33@tcp:36:bash.0 00010000:00010000:0.0:1788587827.028661:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8717 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.028693:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.028707:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587827.028773:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788587827.028801:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e04a92de reply state 00000000260c48bd transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587827.028810:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587827.029005:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+47:10377:x1875470026049024:12345-192.168.206.33@tcp:36:bash.0 Request processed in 711us (1420us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788587827.029022:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 58 00000020:00080000:0.0:1788587827.029029:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788587827.031656:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.031675:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8717 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.031683:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8717 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.031690:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587827.031713:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8717 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.031722:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8717 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.031743:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:2.0:1788587827.031747:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587827.031752:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8717 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.031761:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8717 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587827.037137:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.037273:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026049152 00000100:00100000:3.0:1788587827.037287:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026049152 00000100:00100000:3.0:1788587827.037359:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 59 00000100:00100000:3.0:1788587827.037371:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+46:10377:x1875470026049152:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:3.0:1788587827.037402:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587827.037429:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca871e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db11cc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.037534:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca8725 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.037552:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11c5 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.037562:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca8725 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.037611:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11c5 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.037637:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11c5 expref: 47 pid: 5843 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587827.037653:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043900928:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587827.038074:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7bb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587827.042646:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587827.042861:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026049280 00000100:00100000:2.0:1788587827.042873:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026049280 00010000:00010000:2.0:1788587827.042924:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11c5 expref: 48 pid: 5843 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587827.042989:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 41 00000100:00100000:2.0:1788587827.043000:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+48:2344:x1875470026049280:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587827.043020:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587827.043028:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11c5 expref: 48 pid: 5843 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.043042:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11c5 expref: 48 pid: 5843 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.043071:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:2.0:1788587827.043077:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca8725 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.043108:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca8725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.043117:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca8725 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.043140:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587827.043600:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+48:2344:x1875470026049280:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 597us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587827.043609:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 41 00010000:00010000:3.0:1788587827.043796:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8709 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11c5 expref: 47 pid: 5843 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587827.043820:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043900928:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587827.043978:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca8725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.043990:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca8725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.043995:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca8725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587827.044071:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788587827.044077:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587827.044104:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca8725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.044153:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca871e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11cc expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.044169:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca8725 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11cc expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.044178:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:3.0:1788587827.044180:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587827.044183:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031400, rc 0) 00000100:00100000:3.0:1788587827.044231:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+46:10377:x1875470026049152:12345-192.168.206.33@tcp:101:bash.0 Request processed in 6863us (7110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587827.044252:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 59 00000100:00100000:0.0:1788587827.049198:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587827.049463:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026049536 00000100:00100000:2.0:1788587827.049476:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026049536 00000100:00100000:2.0:1788587827.049545:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 15 00000100:00100000:2.0:1788587827.049557:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f483777050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+46:10377:x1875470026049536:12345-192.168.206.33@tcp:35:bash.0 00000100:00100000:2.0:1788587827.050217:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f483777050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+47:10377:x1875470026049536:12345-192.168.206.33@tcp:35:bash.0 Request processed in 658us (1028us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788587827.050226:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 15 00000100:00100000:0.0:1788587827.123591:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.123700:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026049792 00000100:00100000:3.0:1788587827.123714:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026049792 00000100:00100000:3.0:1788587827.123789:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 60 00000100:00100000:3.0:1788587827.123801:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+47:10387:x1875470026049792:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587827.123831:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587827.123907:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca872c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db11d3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587827.124030:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788587827.124474:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca872c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11d3 expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.124491:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44900) 00010000:00010000:3.0:1788587827.124495:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587827.124500:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca872c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11d3 expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.124514:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031800, rc 0) 00000100:00100000:3.0:1788587827.124646:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+48:10387:x1875470026049792:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 846us (1068us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788587827.124654:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 60 00000100:00100000:1.0:1788587827.133788:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587827.133996:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026049920 00000100:00100000:0.0:1788587827.134009:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026049920 00000100:00100000:0.0:1788587827.134424:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 61 00000100:00100000:0.0:1788587827.134529:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+48:10387:x1875470026049920:12345-192.168.206.33@tcp:34:lfs.0 00010000:00010000:0.0:1788587827.134721:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca873a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.134740:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca873a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.134752:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca873a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.134768:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8741 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.134775:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.134781:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135516:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8748 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135530:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135539:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587827.135591:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135695:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca873a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135702:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca873a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135710:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca873a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135715:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587827.135720:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca873a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135728:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca873a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135741:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:1.0:1788587827.135743:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587827.135748:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca873a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135756:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca873a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135773:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135778:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8741 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135785:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8741 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135795:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587827.135798:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8741 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135804:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8741 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135811:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f489033400) 00010000:00010000:1.0:1788587827.135813:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587827.135815:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8741 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135821:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a600/0xa13e120d54ca8741 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.135838:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.139039:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8748 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.139052:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.139059:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587827.139065:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.139082:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8748 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.139131:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:1.0:1788587827.139134:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587827.139141:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8748 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.139148:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8748 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587827.139533:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+48:10387:x1875470026049920:12345-192.168.206.33@tcp:34:lfs.0 Request processed in 5092us (5752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587827.139547:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 61 00000100:00100000:0.0:1788587827.144371:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587827.144636:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026050176 00000100:00100000:1.0:1788587827.144649:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026050176 00000100:00100000:1.0:1788587827.144726:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 16 00000100:00100000:1.0:1788587827.144738:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+48:10387:x1875470026050176:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:2.0:1788587827.145501:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+49:10387:x1875470026050176:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 759us (1139us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788587827.145512:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 16 00000100:00100000:0.0:1788587827.206909:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.207093:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026050432 00000100:00100000:3.0:1788587827.207107:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026050432 00000100:00100000:3.0:1788587827.207200:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 62 00000100:00100000:3.0:1788587827.207212:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+49:10390:x1875470026050432:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587827.207264:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587827.207290:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca874f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db11da expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207387:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8756 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207404:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8756 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207418:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8756 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207435:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca875d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207443:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca875d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207450:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca875d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207596:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8764 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207606:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207613:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587827.207639:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788587827.207768:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8756 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207776:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8756 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207782:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8756 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207788:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587827.207793:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8756 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207801:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8756 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207815:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:3.0:1788587827.207819:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587827.207825:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8756 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.207832:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8756 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.208498:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca875d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.208508:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca875d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.208514:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca875d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.208519:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587827.208531:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca875d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.208538:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca875d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.208548:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f484d44400) 00010000:00010000:3.0:1788587827.208551:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587827.208554:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca875d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.208560:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca875d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.212257:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca874f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11da expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.212299:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8764 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11da expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.212337:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:2.0:1788587827.212341:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587827.212345:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030200, rc 0) 00000100:00100000:2.0:1788587827.212496:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+51:10390:x1875470026050432:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 5285us (5608us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788587827.212506:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 62 00000100:00100000:2.0:1788587827.216147:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587827.216184:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.216245:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026050688 00000100:00100000:3.0:1788587827.216267:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026050688 00000100:00100000:0.0:1788587827.216303:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026050560 00000100:00100000:0.0:1788587827.216310:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026050560 00000100:00100000:3.0:1788587827.216340:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 63 00000100:00100000:3.0:1788587827.216355:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+52:10390:x1875470026050688:12345-192.168.206.33@tcp:54:lfs.0 00000100:00100000:0.0:1788587827.216363:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 4 00000100:00100000:0.0:1788587827.216373:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+52:2344:x1875470026050560:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587827.216391:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587827.216440:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8764 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11da expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.216442:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.216467:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.216479:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.219538:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:0.0:1788587827.219555:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587827.219966:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+51:2344:x1875470026050560:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 3516us (3754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587827.219981:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 4 00010000:00010000:3.0:1788587827.222405:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.222549:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8772 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.222583:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.222590:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587827.222596:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.222608:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.222705:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:3.0:1788587827.222710:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587827.222716:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8772 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.222724:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587827.223078:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+50:10390:x1875470026050688:12345-192.168.206.33@tcp:54:lfs.0 Request processed in 6719us (6884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587827.223091:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 63 00000100:00100000:2.0:1788587827.225588:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.225679:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026050944 00000100:00100000:3.0:1788587827.225691:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026050944 00000100:00100000:3.0:1788587827.225754:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 17 00000100:00100000:3.0:1788587827.225766:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+50:10390:x1875470026050944:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:3.0:1788587827.226144:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+51:10390:x1875470026050944:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 378us (566us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788587827.226153:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 17 00000100:00100000:0.0:1788587827.363029:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587827.363158:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026051200 00000100:00100000:1.0:1788587827.363172:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026051200 00000100:00100000:1.0:1788587827.363250:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 64 00000100:00100000:1.0:1788587827.363551:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+51:10408:x1875470026051200:12345-192.168.206.33@tcp:101:cat.0 00010000:00010000:1.0:1788587827.363583:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587827.363610:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca8779 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db11e1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.363809:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8780 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.363828:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8780 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.363904:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8780 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587827.363921:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788587827.364086:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca8779 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11e1 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.364109:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8780 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11e1 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.364120:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:1.0:1788587827.364124:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788587827.364132:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481668c00, rc 0) 00000100:00100000:1.0:1788587827.364219:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+53:10408:x1875470026051200:12345-192.168.206.33@tcp:101:cat.0 Request processed in 960us (1209us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788587827.364229:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 64 00000100:00100000:1.0:1788587827.393207:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587827.393289:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026051328 00000100:00100000:2.0:1788587827.393302:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026051328 00000100:00100000:2.0:1788587827.393442:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 65 00000100:00100000:2.0:1788587827.393455:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+53:10409:x1875470026051328:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:2.0:1788587827.393486:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587827.393512:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca878e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db11e8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.393643:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8795 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.393665:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.393680:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587827.393799:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788587827.393810:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587827.394225:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.394262:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca878e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11e8 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.394283:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8795 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11e8 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.394294:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:2.0:1788587827.394297:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587827.394302:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d600, rc 0) 00000100:00100000:2.0:1788587827.395709:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:10409:x1875470026051328:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 2244us (2503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587827.395722:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 65 00000100:00100000:2.0:1788587827.400659:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.400765:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026051712 00000100:00100000:3.0:1788587827.400777:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026051712 00000100:00100000:3.0:1788587827.400928:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 18 00000100:00100000:3.0:1788587827.400940:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:10409:x1875470026051712:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:3.0:1788587827.401406:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10409:x1875470026051712:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 466us (758us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788587827.401415:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 18 00000100:00100000:0.0:1788587827.405735:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587827.405877:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026051840 00000100:00100000:1.0:1788587827.405890:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026051840 00000100:00100000:1.0:1788587827.405971:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:1.0:1788587827.405982:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10409:x1875470026051840:12345-192.168.206.33@tcp:103:lfs.0 00010000:00010000:1.0:1788587827.406001:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788587827.406034:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca8725 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11cc expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.406059:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8780 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11e1 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.406092:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca8630 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db118d expref: 53 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.406103:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44b00) 00010000:00010000:1.0:1788587827.406116:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587827.406196:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+52:10409:x1875470026051840:12345-192.168.206.33@tcp:103:lfs.0 Request processed in 215us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587827.406204:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:1.0:1788587827.408168:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.408751:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026051968 00000100:00100000:3.0:1788587827.408765:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026051968 00000100:00100000:3.0:1788587827.408886:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 66 00000100:00100000:3.0:1788587827.408898:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+52:10409:x1875470026051968:12345-192.168.206.33@tcp:58:lfs.0 00010000:00010000:3.0:1788587827.409069:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca879c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.409089:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca879c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.409103:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca879c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587827.409505:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587827.409756:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788587827.409838:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788587827.410008:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+52:10409:x1875470026051968:12345-192.168.206.33@tcp:58:lfs.0 Request processed in 1109us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587827.410018:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 66 00000100:00100000:2.0:1788587827.423575:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587827.423715:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026052096 00000100:00100000:1.0:1788587827.423729:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026052096 00000100:00100000:1.0:1788587827.423835:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 67 00000100:00100000:1.0:1788587827.424031:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+52:10411:x1875470026052096:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587827.424064:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587827.424097:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca87a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db11ef expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.424345:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.424362:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.424375:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.424394:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.424419:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.424427:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.424542:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca87b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.424552:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca87b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.424559:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca87b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587827.424607:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788587827.424613:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587827.425337:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca87b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425355:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca87b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425366:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425503:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425512:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425538:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587827.425544:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425552:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425567:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:1.0:1788587827.425571:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587827.425576:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425583:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425601:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425607:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425613:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425619:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587827.425622:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425639:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425658:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f48fa37d00) 00010000:00010000:1.0:1788587827.425661:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587827.425664:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425670:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425719:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca87a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11ef expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425735:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca87b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11ef expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.425743:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44400) 00010000:00010000:1.0:1788587827.425745:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587827.425748:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481669400, rc 0) 00000100:00100000:1.0:1788587827.426133:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+53:10411:x1875470026052096:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 2099us (2561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587827.426143:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 67 00010000:00010000:2.0:1788587827.656026:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587827.720180:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587827.720192:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587827.720265:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788587827.720274:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788587827.720451:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bacbe300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875470043901056:192.168.206.33@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587827.720592:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48341c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587827.730493:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bacbe300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875470043901056:192.168.206.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788587827.736891:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.738712:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026052224 00000100:00100000:3.0:1788587827.738730:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026052224 00000100:00100000:3.0:1788587827.738835:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 1 00000100:00100000:3.0:1788587827.738870:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+53:10422:x1875470026052224:12345-192.168.206.33@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788587827.739134:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+53:10422:x1875470026052224:12345-192.168.206.33@tcp:900:lhsmtool_posix.0 Request processed in 265us (2257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587827.739144:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 1 00000100:00100000:2.0:1788587827.744305:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587827.744701:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026052352 00000100:00100000:0.0:1788587827.744715:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026052352 00000100:00100000:0.0:1788587827.744797:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 68 00000100:00100000:0.0:1788587827.744808:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+53:10422:x1875470026052352:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788587827.744871:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788587827.745019:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+53:10422:x1875470026052352:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 Request processed in 212us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587827.745028:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 68 00000100:00100000:1.0:1788587827.748966:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.749321:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026052480 00000100:00100000:3.0:1788587827.749336:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026052480 00000100:00100000:3.0:1788587827.749418:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 69 00000100:00100000:3.0:1788587827.749431:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+53:10422:x1875470026052480:12345-192.168.206.33@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788587827.749539:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca87bf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749561:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca87bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749578:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca87bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749597:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca87c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749606:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca87c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749614:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca87c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749661:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca87cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749671:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca87cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749695:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca87cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587827.749746:0:7276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788587827.749752:0:7276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587827.749767:0:7276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca87cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749780:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca87bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749788:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca87bf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749795:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca87bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749802:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587827.749807:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca87bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749816:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca87bf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749831:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44800) 00010000:00010000:3.0:1788587827.749834:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587827.749877:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca87bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749885:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca87bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749914:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca87c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749922:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca87c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749929:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca87c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749936:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587827.749940:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca87c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749947:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca87c6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749956:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff88f484d44000) 00010000:00010000:3.0:1788587827.749959:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587827.749962:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca87c6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749968:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca87c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749986:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca87cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749993:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca87cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.749999:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca87cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.750012:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587827.750015:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca87cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.750022:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca87cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.750031:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44400) 00010000:00010000:3.0:1788587827.750034:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587827.750037:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca87cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.750043:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca87cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587827.750442:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+53:10422:x1875470026052480:12345-192.168.206.33@tcp:34:lhsmtool_posix.0 Request processed in 1010us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587827.750454:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 69 00000100:00100000:1.0:1788587827.754300:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587827.754350:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026052736 00000100:00100000:1.0:1788587827.754362:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026052736 00000100:00100000:1.0:1788587827.755112:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 70 00000100:00100000:1.0:1788587827.755219:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+53:10422:x1875470026052736:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587827.755248:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587827.755276:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db11f6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.756633:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.756664:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.756680:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587827.756699:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788587827.756839:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.756864:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.756871:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.756878:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587827.756883:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.756892:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.756908:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44400) 00010000:00010000:1.0:1788587827.756928:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587827.756936:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.756945:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca87db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.757011:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87d4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11f6 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.757025:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44800) 00010000:00010000:1.0:1788587827.757027:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587827.757032:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11f6 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.757041:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481669200, rc 0) 00000100:00100000:2.0:1788587827.760582:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.761307:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026052864 00000100:00100000:3.0:1788587827.761323:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026052864 00000100:00100000:3.0:1788587827.761413:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 71 00000100:00100000:3.0:1788587827.761426:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10422:x1875470026052864:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 00000100:00100000:1.0:1788587827.761562:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10422:x1875470026052736:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 6344us (7274us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788587827.761573:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 70 00000004:00000080:3.0:1788587827.761829:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788587827.761996:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:10422:x1875470026052864:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 Request processed in 573us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587827.762010:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 71 00000100:00100000:2.0:1788587827.770316:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.770795:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026053120 00000100:00100000:3.0:1788587827.770808:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026053120 00000100:00100000:3.0:1788587827.770909:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 72 00000100:00100000:3.0:1788587827.770921:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:10422:x1875470026053120:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587827.770946:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587827.770950:0:7276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788587827.770981:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8795 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11e8 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.771003:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:3.0:1788587827.771010:0:7276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587827.771027:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca87e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db11fd expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788587827.781588:0:7276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788587827.781905:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca87f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.781939:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca87f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.781953:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca87f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.782030:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca87e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11fd expref: 56 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.782052:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca87f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11fd expref: 55 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.782062:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88f489033500) 00010000:00010000:0.0:1788587827.782065:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587827.782069:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b400, rc 0) 00000100:00100000:0.0:1788587827.782591:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10422:x1875470026053120:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 11668us (12285us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788587827.782602:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 72 00000100:00100000:2.0:1788587827.791649:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587827.791875:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026053376 00000100:00100000:1.0:1788587827.791888:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026053376 00000100:00100000:1.0:1788587827.791955:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 73 00000100:00100000:1.0:1788587827.791967:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10422:x1875470026053376:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788587827.792046:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587827.792083:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca87f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11fd expref: 55 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.792109:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88f489033500) 00010000:00010000:1.0:1788587827.792655:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587827.792690:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.792706:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.792720:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.792944:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8805 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xfeca39a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.792968:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfeca39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.792982:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfeca39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.793052:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.793071:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.793079:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.793085:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587827.793089:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.793097:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.793124:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:1.0:1788587827.793127:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587827.793132:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.793138:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca87fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.793152:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfeca39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.793159:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8805 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfeca39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.793165:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8805 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfeca39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.793170:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587827.793173:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8805 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfeca39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.793178:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8805 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfeca39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.793186:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xfeca39a (ffff88f48fa37d00) 00010000:00010000:1.0:1788587827.793188:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587827.793191:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8805 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfeca39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587827.793197:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8805 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfeca39a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587827.793311:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:10422:x1875470026053376:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 1342us (1684us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587827.793319:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 73 00000100:00100000:2.0:1788587827.795680:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.795794:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026053504 00000100:00100000:3.0:1788587827.795806:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026053504 00000100:00100000:2.0:1788587827.796047:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 74 00000100:00100000:2.0:1788587827.796061:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:10422:x1875470026053504:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587827.796088:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587827.796191:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca880c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1204 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.796264:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8813 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.796281:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.796295:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.796678:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca880c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1204 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.796704:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1204 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.796716:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88f488834800) 00010000:00010000:2.0:1788587827.796719:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587827.796724:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d400, rc 0) 00000100:00100000:2.0:1788587827.797095:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10422:x1875470026053504:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 1035us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587827.797104:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 74 00000100:00100000:2.0:1788587827.799787:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587827.799955:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026053760 00000100:00100000:0.0:1788587827.799967:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026053760 00000100:00100000:0.0:1788587827.800031:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 75 00000100:00100000:0.0:1788587827.800042:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10422:x1875470026053760:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587827.800264:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca881a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.800284:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca881a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.800317:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca881a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587827.800833:0:7276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788587827.802589:0:7276:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 275057743627ns, next at 276057732819ns, rc = 0 00000004:00010000:0.0:1788587827.802799:0:7276:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6d66ce0 reply state 00000000406836e4 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca881a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587827.802814:0:7276:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587827.802991:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+57:10422:x1875470026053760:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 2945us (3209us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788587827.803002:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 75 00000100:00100000:1.0:1788587827.806182:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587827.806758:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026053888 00000100:00100000:2.0:1788587827.806774:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026053888 00000100:00100000:3.0:1788587827.806958:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 76 00000100:00100000:3.0:1788587827.806974:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+57:10422:x1875470026053888:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587827.807010:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587827.807039:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8821 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db120b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.807139:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8821 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db120b expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.807159:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8821 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db120b expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.807185:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88f488834800) 00010000:00010000:3.0:1788587827.807209:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587827.807214:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031200, rc 0) 00000100:00100000:3.0:1788587827.807301:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+58:10422:x1875470026053888:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 331us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587827.807309:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 76 00010000:00010000:0.0:1788587827.808702:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca881a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.808726:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca881a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.808735:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca881a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.808801:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587827.808807:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca881a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.808816:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca881a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.808835:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88f488834800) 00010000:00010000:0.0:1788587827.808838:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788587827.809001:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca881a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587827.809010:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca881a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587827.813909:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587827.814052:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026054016 00000100:00100000:2.0:1788587827.814065:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026054016 00000100:00100000:2.0:1788587827.814114:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 24 00000100:00100000:2.0:1788587827.814138:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2343:x1875470026054016:12345-192.168.206.33@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788587827.814201:0:9214:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:2.0:1788587827.814238:0:9214:0:(genops.c:1385:class_connect()) connect: client 5bcb85a0-1673-40ab-a41b-fd8baee9796e, cookie 0xa13e120d54ca8828 00002000:00100000:2.0:1788587827.814253:0:9214:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5bcb85a0-1673-40ab-a41b-fd8baee9796e/ffff88f491fdc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788587827.814284:0:9214:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788587827.814592:0:9214:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788587827.814640:0:9214:0:(import.c:65:import_set_state_nolock()) ffff88f491fdf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587827.814735:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2343:x1875470026054016:12345-192.168.206.33@tcp:8:lhsmtool_posix.0 Request processed in 610us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587827.814744:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 24 00000100:00100000:2.0:1788587827.819548:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.820096:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026054144 00000100:00100000:3.0:1788587827.820110:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026054144 00000100:00100000:3.0:1788587827.820322:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 25 00000100:00100000:3.0:1788587827.820337:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:0:x1875470026054144:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788587827.823289:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788587827.878279:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000001:00080000:1.0:1788587827.878305:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1788587827.882253:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:0:x1875470026054144:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 Request processed in 61904us (62699us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788587827.882271:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 25 00000100:00100000:1.0:1788587827.902298:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587827.904037:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026054400 00000100:00100000:0.0:1788587827.904056:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026054400 00000100:00100000:0.0:1788587827.904135:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 19 00000100:00100000:0.0:1788587827.904148:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+57:10422:x1875470026054400:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788587827.904455:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+58:10422:x1875470026054400:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 Request processed in 309us (2167us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788587827.904464:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 19 00000100:00100000:0.0:1788587827.907533:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.907693:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026054656 00000100:00100000:3.0:1788587827.907706:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026054656 00000100:00100000:3.0:1788587827.907781:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 77 00000100:00100000:3.0:1788587827.907792:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+58:10422:x1875470026054656:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788587827.907952:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+58:10422:x1875470026054656:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 161us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587827.907961:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 77 00000100:00100000:0.0:1788587827.911529:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.911674:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026054784 00000100:00100000:3.0:1788587827.911686:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026054784 00000100:00100000:3.0:1788587827.911758:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 78 00000100:00100000:3.0:1788587827.911771:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+58:10422:x1875470026054784:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587827.911796:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587827.911823:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca882f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1212 expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.911964:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8836 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.911989:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.912003:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587827.912050:0:7276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587827.912074:0:7276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.912108:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca882f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1212 expref: 60 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.912142:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8836 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1212 expref: 59 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.912152:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88f488834800) 00010000:00010000:3.0:1788587827.912156:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788587827.912161:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031000, rc 0) 00000100:00100000:3.0:1788587827.912236:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:10422:x1875470026054784:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 468us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587827.912244:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 78 00000100:00100000:1.0:1788587827.915370:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.915617:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026054912 00000100:00100000:3.0:1788587827.915639:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026054912 00000100:00100000:3.0:1788587827.915704:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 26 00000100:00100000:3.0:1788587827.915716:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2344:x1875470026054912:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587827.915738:0:9214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587827.915780:0:9214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca883d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1219 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587827.915816:0:9214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9baf32, blocks: 0x1 00010000:00010000:3.0:1788587827.915865:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=275s v=(0 0) 00010000:00010000:3.0:1788587827.915871:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587827.915883:0:9214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca883d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1219 expref: 6 pid: 9214 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.915906:0:9214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca883d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1219 expref: 6 pid: 9214 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.915922:0:9214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030600, rc 0) 00000100:00100000:3.0:1788587827.915993:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2344:x1875470026054912:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 278us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587827.916000:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 26 00000100:00100000:3.0:1788587827.918873:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587827.919073:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026055168 00000100:00100000:0.0:1788587827.919085:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026055168 00000100:00100000:0.0:1788587827.919167:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 79 00000100:00100000:0.0:1788587827.919179:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:10422:x1875470026055168:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788587827.919318:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:10422:x1875470026055168:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 141us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587827.919327:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 79 00000100:00100000:0.0:1788587827.922600:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587827.922721:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026055296 00000100:00100000:2.0:1788587827.922733:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026055296 00000100:00100000:2.0:1788587827.922840:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 27 00000100:00100000:2.0:1788587827.922888:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:10422:x1875470026055296:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587827.922911:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587827.922934:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dddffbaa/0xa13e120d54ca8844 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1220 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.922975:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca883d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1219 expref: 7 pid: 9214 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.922986:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587827.923005:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587827.923013:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dddffbaa/0xa13e120d54ca8844 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1220 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.923061:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca883d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1219 expref: 7 pid: 9214 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587827.923079:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca883d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1219 expref: 7 pid: 9214 timeout: 375 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587827.923097:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875470043901184:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587827.923223:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4eca300 going to sleep for 11 seconds 00000100:00100000:3.0:1788587827.926465:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.926503:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026055424 00000100:00100000:3.0:1788587827.926513:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026055424 00010000:00010000:3.0:1788587827.926561:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca883d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1219 expref: 8 pid: 9214 timeout: 375 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587827.926604:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 42 00000100:00100000:3.0:1788587827.926614:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2345:x1875470026055424:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587827.926644:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587827.926689:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca883d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1219 expref: 8 pid: 9214 timeout: 375 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.926705:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca883d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1219 expref: 8 pid: 9214 timeout: 375 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.926735:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587827.926740:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587827.926750:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dddffbaa/0xa13e120d54ca8844 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1220 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.926762:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dddffbaa/0xa13e120d54ca8844 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1220 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.926806:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dddffbaa/0xa13e120d54ca8844 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1220 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587827.926823:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4867b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1875470043901312:192.168.206.33@tcp:105: 00000100:00100000:3.0:1788587827.926936:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7f0c00 going to sleep for 11 seconds 00010000:00010000:3.0:1788587827.927080:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca883d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1219 expref: 8 pid: 9214 timeout: 375 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587827.927098:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875470043901184:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587827.927128:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dddffbaa/0xa13e120d54ca8844 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1220 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587827.927154:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d800, rc 0) 00000100:00100000:3.0:1788587827.927195:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:10422:x1875470026055296:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 4310us (4608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587827.927204:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 27 00000100:00100000:3.0:1788587827.937078:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587827.937521:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026055552 00000100:00100000:3.0:1788587827.937536:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026055552 00002000:00100000:3.0:1788587827.937599:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff88f48576c700 x1875470026055552/t0(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:388/0 lens 504/0 e 0 to 0 dl 1788587838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587827.937611:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f48576c700 with x1875470026055552 ext(0->8) 00002000:00010000:3.0:1788587827.937618:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f48576c700 00000100:00100000:3.0:1788587827.937667:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00100000:3.0:1788587827.937679:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2344:x1875470026055552:12345-192.168.206.33@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788587827.938721:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4867b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1875470043901312:192.168.206.33@tcp:105: 00010000:00010000:2.0:1788587827.938757:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587827.939567:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2344:x1875470026055552:12345-192.168.206.33@tcp:4:lhsmtool_posix.0 Request processed in 1882us (2492us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788587827.939582:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 0 00002000:00100000:3.0:1788587827.939593:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff88f48576c700 x1875470026055552/t4294967302(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:388/0 lens 504/448 e 0 to 0 dl 1788587838 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788587827.940175:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2345:x1875470026055424:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 13551us (13712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587827.940189:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 42 00002000:00100000:3.0:1788587827.941335:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f48576c700 with x1875470026055552 ext(0->8) 00002000:00010000:3.0:1788587827.941345:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f48576c700 00000100:00100000:2.0:1788587827.956530:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587827.956632:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026055680 00000100:00100000:0.0:1788587827.956644:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026055680 00000100:00100000:0.0:1788587827.956710:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 80 00000100:00100000:0.0:1788587827.956721:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:10422:x1875470026055680:12345-192.168.206.33@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788587828.021178:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:10422:x1875470026055680:12345-192.168.206.33@tcp:44:lhsmtool_posix.0 Request processed in 64441us (64642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587828.021195:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 80 00000001:00080000:0.0:1788587828.021256:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1788587828.021271:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:0.0:1788587828.021407:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788587828.021426:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88f4bf7bb600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788587828.021431:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f4b530be00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88f4bf7bbc00 00000020:00080000:0.0:1788587828.021434:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f4b530b100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88f4b531b800 00000020:00080000:0.0:1788587828.021864:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788587828.022015:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788587828.022038:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bacbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043901440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788587828.022108:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587828.022179:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587828.022187:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bacbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043901568:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788587828.022217:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587828.022258:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043901440 00000100:00100000:0.0:1788587828.022267:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043901440 00000100:00100000:0.0:1788587828.022323:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043901568 00000100:00100000:0.0:1788587828.022327:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043901568 00000100:00100000:0.0:1788587828.022359:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587828.022370:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043901440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788587828.022572:0:9214:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788587828.022576:0:9214:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788587826 00002000:00010000:0.0:1788587828.022579:0:9214:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788587828.023361:0:9214:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788587826 -> 1788587826 00002000:00010000:0.0:1788587828.023383:0:9214:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788587828.023799:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587828.023817:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043901568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788587828.023872:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788587828.023910:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9baf30, atime: 0x6a9baf30, ctime: 0x6a9baf30, blocks: 0x1 00010000:00010000:0.0:1788587828.023920:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca884b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.023939:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=275s v=(0 0) 00010000:00010000:0.0:1788587828.023945:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587828.023952:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca884b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.023972:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca884b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.023983:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca884b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.023992:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca884b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.024014:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788587828.025155:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587828.025551:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1875470043901568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1740us (3331us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788587828.025562:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587828.025594:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026055808 00000100:00100000:0.0:1788587828.025609:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026055808 00000100:00100000:0.0:1788587828.025658:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 30 00000100:00100000:0.0:1788587828.025667:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2346:x1875470026055808:12345-192.168.206.33@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1788587828.025741:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587828.025747:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788587828.025771:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587828.025784:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca884b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.025799:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a200 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:0.0:1788587828.025805:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca884b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.025817:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca884b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.025871:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca884b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.025882:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca884b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.025913:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587828.025916:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587828.025918:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587828.025960:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043901440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3591us (3851us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788587828.025968:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:2.0:1788587828.030903:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88f4bacbca80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788587828.030923:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bacbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043901568:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788587828.030940:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88f4bacbfb80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788587828.030945:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bacbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043901440:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1788587828.071714:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1788587828.071731:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1788587828.071890:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026055808:12345-192.168.206.33@tcp:16:lhsmtool_posix.0 Request processed in 46219us (46738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587828.071901:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 30 00000100:00100000:0.0:1788587828.078603:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587828.078945:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026056064 00000100:00100000:3.0:1788587828.078956:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026056064 00000100:00100000:3.0:1788587828.079017:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 81 00000100:00100000:3.0:1788587828.079037:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:10422:x1875470026056064:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788587828.079087:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587828.079114:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8836 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1212 expref: 13 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.079132:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88f488834800) 00010000:00010000:3.0:1788587828.079138:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587828.079166:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8852 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.079181:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8852 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.079191:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8852 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587828.079660:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac20656c reply state 000000000265a866 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8852 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587828.079671:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587828.079774:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:10422:x1875470026056064:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 739us (1178us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788587828.079782:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 81 00000100:00100000:3.0:1788587828.085763:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587828.086087:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026056192 00000100:00100000:0.0:1788587828.086097:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026056192 00010000:00010000:1.0:1788587828.086099:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8852 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.086115:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8852 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.086122:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8852 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.086129:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587828.086133:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8852 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.086141:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8852 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587828.086151:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 31 00010000:00010000:1.0:1788587828.086162:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88f488834800) 00000100:00100000:0.0:1788587828.086163:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2344:x1875470026056192:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 00010000:00010000:1.0:1788587828.086170:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587828.086176:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8852 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.086194:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8852 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587828.087456:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788587828.087462:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788587826 -> 1788587825 00002000:00010000:0.0:1788587828.087464:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788587824 00002000:00010000:0.0:1788587828.087466:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788587826 -> 1788587825 00002000:00010000:0.0:1788587828.087469:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788587828.089261:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2344:x1875470026056192:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 Request processed in 3092us (3499us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788587828.089274:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 31 00000100:00100000:0.0:1788587828.094494:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587828.094528:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026056448 00000100:00100000:0.0:1788587828.094536:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026056448 00000100:00100000:0.0:1788587828.094598:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 82 00000100:00100000:0.0:1788587828.094611:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:10422:x1875470026056448:12345-192.168.206.33@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788587828.094939:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.094957:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8813 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1204 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.094979:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.095018:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1204 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.095032:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8813 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1204 expref: 13 pid: 5843 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587828.095049:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf5e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8471:1875470043901696:192.168.206.33@tcp:104: 00000100:00100000:0.0:1788587828.095197:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48341c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788587828.098756:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587828.098795:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf5e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8471:1875470043901696:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587828.098823:0:8471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587828.099565:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026056576 00000100:00100000:0.0:1788587828.099573:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026056576 00010000:00010000:0.0:1788587828.099605:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8813 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1204 expref: 14 pid: 5843 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587828.099657:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 43 00000100:00100000:0.0:1788587828.099666:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:2344:x1875470026056576:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587828.099682:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587828.099689:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8813 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1204 expref: 14 pid: 5843 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.099701:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1204 expref: 14 pid: 5843 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.099735:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8813 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1204 expref: 14 pid: 5843 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.100531:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88f488834800) 00010000:00010000:0.0:1788587828.100537:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.100546:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.100554:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.100581:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587828.100639:0:8471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587828.100644:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:2344:x1875470026056576:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 977us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587828.100659:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 43 00010000:00010000:3.0:1788587828.100662:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.100691:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.100698:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.100705:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.100711:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587828.100716:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.100723:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.100734:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88f488834800) 00010000:00010000:3.0:1788587828.100737:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788587828.100742:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.100748:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8859 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587828.100809:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+12:10422:x1875470026056448:12345-192.168.206.33@tcp:55:lhsmtool_posix.0 Request processed in 6198us (6321us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788587828.100818:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 82 00000100:00100000:0.0:1788587828.110438:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587828.110547:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026056704 00000100:00100000:3.0:1788587828.110753:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026056704 00000100:00100000:3.0:1788587828.110855:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 32 00000100:00100000:3.0:1788587828.110865:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2345:x1875470026056704:12345-192.168.206.33@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788587828.110902:0:9214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca8860 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.110920:0:9214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dddffbaa/0xa13e120d54ca8844 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1220 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.110928:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587828.110932:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587828.110936:0:9214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca8860 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.111351:0:9214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dddffbaa/0xa13e120d54ca8844 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1220 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.111369:0:9214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dddffbaa/0xa13e120d54ca8844 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1220 expref: 7 pid: 6693 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587828.111385:0:9214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9214:1875470043901824:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587828.111464:0:9214:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf713600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587828.115878:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587828.116096:0:9214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9214:1875470043901824:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587828.116134:0:9214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca8860 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587828.118271:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026056832 00000100:00100000:2.0:1788587828.118287:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026056832 00010000:00010000:2.0:1788587828.118325:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dddffbaa/0xa13e120d54ca8844 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1220 expref: 8 pid: 6693 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587828.118356:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 44 00000100:00100000:2.0:1788587828.118364:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026056832:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587828.118377:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587828.118397:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dddffbaa/0xa13e120d54ca8844 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1220 expref: 8 pid: 6693 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.118412:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dddffbaa/0xa13e120d54ca8844 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1220 expref: 8 pid: 6693 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.118433:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dddffbaa/0xa13e120d54ca8844 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1220 expref: 8 pid: 6693 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.118446:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587828.118451:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587828.118457:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca8860 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.118467:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca8860 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.118503:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587828.118569:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2344:x1875470026056832:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 205us (2699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587828.118586:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 44 00010000:00010000:0.0:1788587828.120820:0:9214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca8860 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.120838:0:9214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca8860 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.120898:0:9214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca8860 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.120918:0:9214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca8860 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.120927:0:9214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca8860 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.120933:0:9214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030600 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:0.0:1788587828.120937:0:9214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca8860 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.120946:0:9214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca8860 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.120965:0:9214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca8860 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.120973:0:9214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f091106a/0xa13e120d54ca8860 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587828.121326:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2345:x1875470026056704:12345-192.168.206.33@tcp:1:lhsmtool_posix.0 Request processed in 10457us (10893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587828.121336:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 32 00000100:00100000:0.0:1788587828.133502:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587828.133565:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026057088 00000100:00100000:1.0:1788587828.133576:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026057088 00000100:00100000:1.0:1788587828.133719:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 83 00000100:00100000:1.0:1788587828.133729:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+12:10422:x1875470026057088:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788587828.133805:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8867 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.133823:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.133865:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.134825:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.134871:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8821 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db120b expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.134880:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.135183:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8821 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db120b expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.135197:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8821 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db120b expref: 13 pid: 5843 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587828.135211:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf725180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043901952:192.168.206.33@tcp:104: 00000100:00100000:0.0:1788587828.135294:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48341ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587828.138644:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587828.138679:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf725180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043901952:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587828.138775:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587828.139180:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026057216 00000100:00100000:3.0:1788587828.139187:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026057216 00010000:00010000:3.0:1788587828.139233:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8821 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db120b expref: 14 pid: 5843 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587828.139280:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 45 00000100:00100000:3.0:1788587828.139290:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:2345:x1875470026057216:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587828.139303:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587828.139310:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8821 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db120b expref: 14 pid: 5843 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.139322:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8821 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db120b expref: 14 pid: 5843 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.139343:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8821 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db120b expref: 14 pid: 5843 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.139355:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88f488834800) 00010000:00010000:3.0:1788587828.139360:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.139369:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.139377:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.139405:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587828.139470:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:2345:x1875470026057216:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 181us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587828.139479:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 45 00010000:00010000:2.0:1788587828.141302:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.141316:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587828.141490:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788587828.141641:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788587828.141990:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788587828.142071:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875470043902080:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788587828.142123:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587828.142144:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4eca480 going to sleep for 11 seconds 00000100:00100000:1.0:1788587828.142547:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043902080 00000100:00100000:1.0:1788587828.142554:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043902080 00000100:00100000:1.0:1788587828.142617:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788587828.142638:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875470043902080:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788587828.142712:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875470043902080:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587828.142729:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587828.145605:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788587828.145614:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88f4bacbfb80, transno 4294967303 00000100:00100000:2.0:1788587828.145645:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875470043902080:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788587828.146061:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788587828.146128:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875470043902208:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788587828.146177:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587828.146196:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4ecac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587828.147740:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043902208 00000100:00100000:1.0:1788587828.147748:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043902208 00000100:00100000:1.0:1788587828.147799:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587828.147807:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875470043902208:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788587828.148038:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1875470043902208:12345-0@lo:1000:mdt00_001.0 Request processed in 230us (1859us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788587828.148045:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587828.152105:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875470043902208:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788587828.152151:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152175:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152181:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152187:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587828.152191:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152197:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152212:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88f488834800) 00010000:00010000:2.0:1788587828.152215:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587828.152219:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152225:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca886e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152263:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca879c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152269:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca879c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152276:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca879c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152281:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587828.152291:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca879c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152297:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca879c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152305:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44400) 00010000:00010000:2.0:1788587828.152307:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587828.152311:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca879c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152316:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca879c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152338:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152352:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca87b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11ef expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152361:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152396:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca87b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11ef expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.152410:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca87b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11ef expref: 16 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587828.152424:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa52680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043902336:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587828.152506:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4ecac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587828.159893:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587828.160006:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa52680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043902336:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587828.160033:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587828.160153:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026057344 00000100:00100000:0.0:1788587828.160160:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026057344 00010000:00010000:0.0:1788587828.160194:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca87b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11ef expref: 17 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587828.160265:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 46 00000100:00100000:0.0:1788587828.160275:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+17:2345:x1875470026057344:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587828.160288:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587828.160296:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca87b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11ef expref: 17 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.160309:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca87b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11ef expref: 17 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.160336:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca87b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db11ef expref: 17 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.160350:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44400) 00010000:00010000:0.0:1788587828.160355:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.160365:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.160373:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.160401:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587828.160444:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:2345:x1875470026057344:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 171us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587828.160451:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 46 00010000:00010000:3.0:1788587828.160500:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160508:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160519:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160526:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160532:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160537:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159da00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587828.160542:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160549:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160558:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44400) 00010000:00010000:3.0:1788587828.160561:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587828.160564:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160570:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8875 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160579:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160594:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8867 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160600:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8867 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160606:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481668c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587828.160609:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8867 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160615:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8867 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160635:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f484d44400) 00010000:00010000:3.0:1788587828.160637:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788587828.160640:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8867 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.160646:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca8867 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587828.160835:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:10422:x1875470026057088:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 27107us (27340us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788587828.160872:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 83 00000020:00080000:3.0:1788587828.160876:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788587828.161001:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587828.161005:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587828.161034:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788587828.161040:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788587828.165333:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587828.165532:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026057600 00000100:00100000:3.0:1788587828.165548:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026057600 00000100:00100000:3.0:1788587828.165600:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 20 00000100:00100000:3.0:1788587828.165610:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:10422:x1875470026057600:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788587828.166253:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788587828.166348:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788587828.166388:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca887c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.166403:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca887c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.166414:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca887c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.166423:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca887c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.166430:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca887c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.166436:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca887c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.166456:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788587828.166532:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+17:10422:x1875470026057600:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 Request processed in 922us (1205us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788587828.166540:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 20 00000020:00080000:3.0:1788587828.166545:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788587828.166996:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587828.167004:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca887c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.167012:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587828.167017:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca887c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.167025:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca887c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.167038:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88f484d44400) 00010000:00010000:1.0:1788587828.167041:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788587828.167045:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca887c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.167051:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca887c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.167069:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587828.167071:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587828.167072:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587828.228325:0:12008:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587828.228333:0:12008:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587828.228367:0:12008:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788587828.228373:0:12008:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587828.340428:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587828.340490:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026057856 00000100:00100000:3.0:1788587828.340499:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026057856 00000100:00100000:3.0:1788587828.340562:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 84 00000100:00100000:3.0:1788587828.340580:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+17:10432:x1875470026057856:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587828.340605:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587828.340634:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8883 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1227 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.340723:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca888a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.340739:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca888a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.340751:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca888a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587828.340762:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788587828.340903:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8883 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1227 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.340919:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca888a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1227 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.340928:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:3.0:1788587828.340931:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788587828.340934:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031400, rc 0) 00000100:00100000:3.0:1788587828.340989:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:10432:x1875470026057856:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 411us (568us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788587828.340997:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 84 00000100:00100000:3.0:1788587828.348171:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587828.348247:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026057984 00000100:00100000:1.0:1788587828.348256:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026057984 00000100:00100000:1.0:1788587828.348300:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 85 00000100:00100000:1.0:1788587828.348308:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:10432:x1875470026057984:12345-192.168.206.33@tcp:34:lfs.0 00010000:00010000:1.0:1788587828.348379:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca8898 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348394:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca8898 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348406:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca8898 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348419:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca889f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348426:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca889f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348432:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca889f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348636:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348645:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348652:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587828.348685:0:8471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348705:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca8898 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348710:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca8898 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348717:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca8898 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348723:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587828.348727:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca8898 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348734:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca8898 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348746:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:1.0:1788587828.348749:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587828.348754:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca8898 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348760:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca8898 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348771:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca889f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348777:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca889f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348783:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca889f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348793:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481668a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587828.348796:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca889f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348802:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca889f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348810:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f48fa37900) 00010000:00010000:1.0:1788587828.348813:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587828.348815:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca889f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348821:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca889f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348835:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348871:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348877:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348882:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587828.348885:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348891:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348908:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:1.0:1788587828.348911:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587828.348914:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.348920:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587828.348991:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:10432:x1875470026057984:12345-192.168.206.33@tcp:34:lfs.0 Request processed in 682us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587828.348999:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 85 00000100:00100000:3.0:1788587828.402141:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587828.402255:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026058240 00000100:00100000:2.0:1788587828.402270:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026058240 00000100:00100000:2.0:1788587828.402344:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 86 00000100:00100000:2.0:1788587828.402356:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:10435:x1875470026058240:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:2.0:1788587828.402376:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587828.402396:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca88ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db122e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403002:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403018:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403030:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403044:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403051:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403058:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403314:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca88c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403331:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca88c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403339:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca88c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587828.403351:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788587828.403443:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403451:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403459:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403465:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159dc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587828.403470:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403478:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403491:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:2.0:1788587828.403494:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587828.403499:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403505:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403518:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403531:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403537:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403542:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587828.403546:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403553:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403562:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f488834800) 00010000:00010000:2.0:1788587828.403564:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587828.403567:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403574:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403628:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca88ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db122e expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403644:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca88c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db122e expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.403652:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f488834b00) 00010000:00010000:2.0:1788587828.403654:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587828.403663:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159da00, rc 0) 00000100:00100000:2.0:1788587828.403737:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:10435:x1875470026058240:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 1383us (1609us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788587828.403745:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 86 00000100:00100000:3.0:1788587828.409667:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587828.409889:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026058368 00000100:00100000:1.0:1788587828.409897:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026058368 00000100:00100000:1.0:1788587828.409988:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 87 00000100:00100000:1.0:1788587828.409999:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:10435:x1875470026058368:12345-192.168.206.33@tcp:54:lfs.0 00010000:00010000:1.0:1788587828.410062:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.410077:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.410088:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.410123:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.410129:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.410150:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.410155:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587828.410159:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.410167:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.410177:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587828.410180:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587828.410184:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.410190:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587828.410260:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:10435:x1875470026058368:12345-192.168.206.33@tcp:54:lfs.0 Request processed in 263us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587828.410267:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 87 00000100:00100000:3.0:1788587828.413578:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587828.413879:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026058624 00000100:00100000:0.0:1788587828.413892:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026058624 00000100:00100000:0.0:1788587828.413961:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 21 00000100:00100000:0.0:1788587828.413974:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f483776450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:10435:x1875470026058624:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:0.0:1788587828.414765:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f483776450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:10435:x1875470026058624:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 790us (1198us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788587828.414794:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 21 00000100:00100000:0.0:1788587828.464327:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587828.464457:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026058880 00000100:00100000:2.0:1788587828.464472:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026058880 00000100:00100000:2.0:1788587828.464541:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 88 00000100:00100000:2.0:1788587828.464554:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:9965:x1875470026058880:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:2.0:1788587828.464586:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587828.464613:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca88d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1235 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.464761:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.464779:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca88c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db122e expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.464789:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.464831:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca88c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db122e expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.464891:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca88c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db122e expref: 23 pid: 5842 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587828.464907:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa52680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875470043902464:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587828.465055:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4856eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587828.467995:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa52680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875470043902464:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587828.468035:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587828.470236:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587828.470457:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026059008 00000100:00100000:1.0:1788587828.470469:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026059008 00010000:00010000:1.0:1788587828.470515:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca88c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db122e expref: 24 pid: 5842 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587828.470558:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 47 00000100:00100000:1.0:1788587828.470567:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:2344:x1875470026059008:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587828.470581:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587828.470599:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca88c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db122e expref: 24 pid: 5842 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.470613:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca88c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db122e expref: 24 pid: 5842 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.470644:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca88c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db122e expref: 24 pid: 5842 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.470661:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587828.470666:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.470675:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.470682:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.470710:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587828.470765:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+23:2344:x1875470026059008:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 199us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587828.470773:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 47 00010000:00010000:2.0:1788587828.470962:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.470980:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587828.471007:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788587828.471250:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca88d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1235 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.471274:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1235 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.471284:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f488834b00) 00010000:00010000:2.0:1788587828.471287:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587828.471291:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159ce00, rc 0) 00000100:00100000:2.0:1788587828.471362:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+23:9965:x1875470026058880:12345-192.168.206.33@tcp:101:bash.0 Request processed in 6810us (7050us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788587828.471372:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 88 00000100:00100000:0.0:1788587828.474147:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587828.474218:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026059264 00000100:00100000:2.0:1788587828.474227:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026059264 00000100:00100000:2.0:1788587828.474277:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 89 00000100:00100000:2.0:1788587828.474293:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+23:9965:x1875470026059264:12345-192.168.206.33@tcp:36:bash.0 00010000:00010000:2.0:1788587828.474551:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.474567:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.474578:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587828.474637:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788587828.474661:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc3f4cc5 reply state 000000000da230c2 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587828.474669:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788587828.474707:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788587828.474793:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+27:9965:x1875470026059264:12345-192.168.206.33@tcp:36:bash.0 Request processed in 507us (653us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788587828.474799:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 89 00000020:00080000:2.0:1788587828.474804:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788587828.477304:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.477320:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.477328:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.477333:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159dc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587828.477337:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.477354:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.477371:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f488834b00) 00010000:00010000:0.0:1788587828.477374:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587828.477379:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.477386:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca88ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587828.479755:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587828.480651:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026059392 00000100:00100000:1.0:1788587828.480660:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026059392 00000100:00100000:1.0:1788587828.480754:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 90 00000100:00100000:1.0:1788587828.480764:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:9965:x1875470026059392:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:1.0:1788587828.480783:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587828.480802:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db123c expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.480905:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db123c expref: 27 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.480921:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db123c expref: 27 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.480940:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587828.480943:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587828.480946:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481669400, rc 0) 00000100:00100000:1.0:1788587828.481006:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+27:9965:x1875470026059392:12345-192.168.206.33@tcp:101:bash.0 Request processed in 243us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587828.481012:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 90 00000100:00100000:3.0:1788587828.485755:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587828.488016:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026059520 00000100:00100000:0.0:1788587828.488057:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026059520 00000100:00100000:0.0:1788587828.488131:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 33 00000100:00100000:0.0:1788587828.488141:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:9965:x1875470026059520:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:0.0:1788587828.488159:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587828.488179:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca88fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1243 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587828.488208:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9baf31, atime: 0x6a9baf30, ctime: 0x6a9baf31, blocks: 0xb 00010000:00010000:0.0:1788587828.488228:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=275s v=(0 0) 00010000:00010000:0.0:1788587828.488233:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587828.488240:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca88fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1243 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.488255:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca88fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1243 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.488268:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77ba00, rc 0) 00000100:00100000:0.0:1788587828.488336:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:9965:x1875470026059520:12345-192.168.206.33@tcp:101:bash.0 Request processed in 196us (2589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587828.488343:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 33 00000100:00100000:0.0:1788587828.497381:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587828.498224:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026059648 00000100:00100000:1.0:1788587828.498234:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026059648 00002000:00010000:1.0:1788587828.498273:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788587828.498278:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4bf727100 with x1875470026059648 ext(0->18446744073709551615) 00002000:00010000:1.0:1788587828.498288:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f4bf727100. 00000100:00100000:1.0:1788587828.498321:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 1 00000100:00100000:1.0:1788587828.498330:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2344:x1875470026059648:12345-192.168.206.33@tcp:10:bash.0 00002000:00010000:1.0:1788587828.498733:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788587828.498737:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788587825 -> 1788587827 00002000:00010000:1.0:1788587828.498739:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788587824 -> 1788587824 00002000:00010000:1.0:1788587828.498741:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788587825 -> 1788587827 00002000:00010000:1.0:1788587828.498742:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788587828.500288:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026059648:12345-192.168.206.33@tcp:10:bash.0 Request processed in 1951us (2908us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788587828.500313:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 1 00002000:00010000:1.0:1788587828.500319:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788587828.500322:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4bf727100 with x1875470026059648 ext(0->18446744073709551615) 00002000:00010000:1.0:1788587828.500330:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f4bf727100. 00000100:00100000:1.0:1788587828.575306:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587828.575386:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026059776 00000100:00100000:2.0:1788587828.575395:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026059776 00000100:00100000:2.0:1788587828.575475:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 91 00000100:00100000:2.0:1788587828.575483:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+27:10449:x1875470026059776:12345-192.168.206.33@tcp:34:lfs.0 00010000:00010000:2.0:1788587828.575546:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8901 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.575558:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8901 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.575570:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8901 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.575602:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8908 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.575610:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.575630:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576113:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca890f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576124:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca890f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576133:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca890f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587828.576172:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca890f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576183:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8901 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576189:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8901 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576195:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8901 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576201:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159de00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587828.576205:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8901 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576220:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8901 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576232:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:2.0:1788587828.576235:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587828.576239:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8901 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576245:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8901 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576257:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576262:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8908 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576267:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576272:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587828.576274:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576280:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8908 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576287:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f488834800) 00010000:00010000:2.0:1788587828.576289:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587828.576292:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8908 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576307:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8908 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576321:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca890f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576327:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca890f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576333:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca890f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576338:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587828.576342:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca890f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576348:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca890f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576356:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f488834b00) 00010000:00010000:2.0:1788587828.576358:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587828.576361:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca890f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.576366:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca890f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587828.576479:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+27:10449:x1875470026059776:12345-192.168.206.33@tcp:34:lfs.0 Request processed in 996us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587828.576488:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 91 00000100:00100000:3.0:1788587828.629368:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587828.629665:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026060032 00000100:00100000:1.0:1788587828.629680:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026060032 00000100:00100000:1.0:1788587828.629755:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 92 00000100:00100000:1.0:1788587828.629765:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+27:10452:x1875470026060032:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587828.629783:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587828.630210:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca8916 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db124a expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.630286:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca891d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.630300:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca891d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.630315:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca891d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.630331:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8924 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.630337:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.630343:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.630793:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca892b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.630804:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca892b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.630811:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca892b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587828.630821:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788587828.630992:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca891d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631000:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca891d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631007:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca891d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631013:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481668c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587828.631017:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca891d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631024:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca891d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631036:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:1.0:1788587828.631039:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587828.631043:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca891d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631059:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668c00/0xa13e120d54ca891d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631073:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631079:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8924 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631084:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631088:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587828.631090:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631096:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8924 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631105:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f48fa37d00) 00010000:00010000:1.0:1788587828.631108:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587828.631111:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8924 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631116:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669a00/0xa13e120d54ca8924 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631154:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669200/0xa13e120d54ca8916 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db124a expref: 30 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631167:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca892b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db124a expref: 29 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.631181:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587828.631183:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788587828.631186:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f481668a00, rc 0) 00000100:00100000:1.0:1788587828.631262:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+29:10452:x1875470026060032:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 1498us (1908us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788587828.631270:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 92 00000100:00100000:0.0:1788587828.635495:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587828.635651:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026060160 00000100:00100000:1.0:1788587828.635660:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026060160 00000100:00100000:1.0:1788587828.635713:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 93 00000100:00100000:1.0:1788587828.635723:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+29:10452:x1875470026060160:12345-192.168.206.33@tcp:54:lfs.0 00010000:00010000:1.0:1788587828.635950:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.635966:0:7276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1235 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.635975:0:7276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.636068:0:7276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1235 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.636082:0:7276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1235 expref: 29 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587828.636095:0:7276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab6d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7276:1875470043902592:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587828.636229:0:7276:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486647f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587828.639533:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587828.639673:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026060416 00000100:00100000:3.0:1788587828.639682:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026060416 00000100:00100000:3.0:1788587828.639732:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 22 00000100:00100000:3.0:1788587828.639742:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:5584:x1875470026060416:12345-192.168.206.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788587828.640180:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:5584:x1875470026060416:12345-192.168.206.33@tcp:35:ldlm_bl.0 Request processed in 438us (653us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788587828.640188:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 22 00000100:00100000:1.0:1788587828.640435:0:7276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab6d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7276:1875470043902592:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587828.640459:0:7276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587828.643694:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587828.643939:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026060544 00000100:00100000:2.0:1788587828.643948:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026060544 00010000:00010000:2.0:1788587828.643985:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1235 expref: 31 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587828.644059:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 48 00000100:00100000:2.0:1788587828.644068:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:2344:x1875470026060544:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587828.644083:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587828.644090:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1235 expref: 31 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.644101:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1235 expref: 31 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.644134:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca88de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1235 expref: 31 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.644151:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f488834b00) 00010000:00010000:2.0:1788587828.644156:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.644164:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.644171:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.644204:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587828.644259:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:2344:x1875470026060544:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 192us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587828.644279:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 48 00010000:00010000:1.0:1788587828.644341:0:7276:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.644349:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.644377:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.644384:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.644391:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.644396:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587828.644400:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.644407:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.644416:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587828.644418:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587828.644422:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.644448:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca8939 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587828.644486:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+29:10452:x1875470026060160:12345-192.168.206.33@tcp:54:lfs.0 Request processed in 8763us (9062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587828.644493:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 93 00000100:00100000:2.0:1788587828.647387:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587828.647731:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026060800 00000100:00100000:3.0:1788587828.647741:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026060800 00000100:00100000:3.0:1788587828.648092:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 23 00000100:00100000:3.0:1788587828.648103:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+29:10452:x1875470026060800:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:3.0:1788587828.648329:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:10452:x1875470026060800:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 227us (959us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788587828.648337:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 23 00010000:00010000:0.0:1788587828.680128:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587828.756744:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587828.756838:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026061056 00000100:00100000:2.0:1788587828.756879:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026061056 00000100:00100000:3.0:1788587828.757147:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 94 00000100:00100000:3.0:1788587828.757159:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:10463:x1875470026061056:12345-192.168.206.33@tcp:101:cat.0 00010000:00010000:3.0:1788587828.757180:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587828.757199:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca8940 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1251 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.757270:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8947 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.757295:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8947 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.757309:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8947 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.757326:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca894e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.757333:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca894e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.757340:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca894e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758304:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8955 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758315:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758323:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587828.758333:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788587828.758414:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8947 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758421:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8947 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758438:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8947 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758452:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587828.758456:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8947 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758463:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8947 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758476:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:3.0:1788587828.758479:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587828.758483:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8947 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758489:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8947 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758501:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca894e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758507:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca894e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758512:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca894e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758516:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587828.758518:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca894e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758524:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca894e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758540:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f484d44100) 00010000:00010000:3.0:1788587828.758543:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587828.758546:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca894e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758552:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca894e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758607:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca8940 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1251 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758630:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8955 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1251 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.758637:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f488834b00) 00010000:00010000:3.0:1788587828.758639:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587828.758641:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031800, rc 0) 00000100:00100000:3.0:1788587828.758704:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:10463:x1875470026061056:12345-192.168.206.33@tcp:101:cat.0 Request processed in 1548us (1970us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788587828.758711:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 94 00000100:00100000:1.0:1788587828.769296:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587828.769719:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026061312 00000100:00100000:0.0:1788587828.769728:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026061312 00000100:00100000:0.0:1788587828.769834:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 24 00000100:00100000:0.0:1788587828.769874:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:10463:x1875470026061312:12345-192.168.206.33@tcp:35:cat.0 00000100:00100000:0.0:1788587828.770119:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:10463:x1875470026061312:12345-192.168.206.33@tcp:35:cat.0 Request processed in 275us (831us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788587828.770126:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 24 00000100:00100000:2.0:1788587828.802717:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587828.803444:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026061568 00000100:00100000:1.0:1788587828.803524:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026061568 00000100:00100000:1.0:1788587828.804856:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 95 00000100:00100000:1.0:1788587828.804872:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:10464:x1875470026061568:12345-192.168.206.33@tcp:36:rm.0 00010000:00010000:1.0:1788587828.804933:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788587828.804958:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8955 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1251 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.804980:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481668a00/0xa13e120d54ca892b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db124a expref: 32 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.804994:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f481669400/0xa13e120d54ca88f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db123c expref: 31 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.805004:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587828.805015:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587828.805035:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8963 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.805048:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8963 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.805070:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8963 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.805086:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca896a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.805093:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca896a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.805100:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca896a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.805311:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8971 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.805320:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8971 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.805326:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8971 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587828.806746:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1788587828.806758:0:8471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 276061915245ns, next at 277061912293ns, rc = 0 00010000:00010000:1.0:1788587828.807225:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8978 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807239:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807249:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807267:0:8471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8978 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807272:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8978 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807278:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8978 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807305:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587828.807327:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8971 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807334:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8971 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807341:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8971 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.807343:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587828.807350:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587828.807354:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8978 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807357:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8971 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.807372:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1a00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587828.807374:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8971 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.807377:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8978 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807393:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f48fa37900) 00010000:00010000:1.0:1788587828.807397:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788587828.807402:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8971 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.807404:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8978 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.807419:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88f48fa37900) 00010000:00010000:1.0:1788587828.807423:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8971 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.807424:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788587828.807429:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8978 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.807436:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8978 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807445:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8963 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807452:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8963 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.807453:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587828.807457:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587828.807459:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8963 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.807461:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587828.807468:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587828.807471:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8963 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807477:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8963 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807485:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:1.0:1788587828.807487:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587828.807491:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8963 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.807496:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8963 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587828.807505:0:8471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2abb9d4 reply state 00000000bb86e07e transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca896a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587828.807513:0:8471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587828.808131:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:10464:x1875470026061568:12345-192.168.206.33@tcp:36:rm.0 Request processed in 3260us (5419us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788587828.808140:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 95 00010000:00010000:3.0:1788587828.811585:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca896a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.811602:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca896a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.811609:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca896a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.811642:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587828.811647:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca896a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.811655:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca896a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.811672:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f48fa37d00) 00010000:00010000:3.0:1788587828.811675:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587828.811680:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca896a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587828.811688:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca896a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587828.867737:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587828.867836:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026061824 00000100:00100000:1.0:1788587828.867953:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026061824 00000100:00100000:0.0:1788587828.868211:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 96 00000100:00100000:0.0:1788587828.868223:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:10470:x1875470026061824:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:0.0:1788587828.868258:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587828.868277:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca897f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1258 expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.868385:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8986 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.868399:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8986 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.868411:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8986 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.868426:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca898d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.868433:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca898d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.868439:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca898d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788587828.869435:0:7276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788587828.869598:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8994 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.869609:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.869631:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.869680:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8986 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.869687:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8986 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.869694:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8986 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.869700:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587828.869704:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8986 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.869711:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8986 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.869724:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:0.0:1788587828.869727:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587828.869731:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8986 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.869737:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8986 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587828.869750:0:7276:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075d090eb reply state 0000000047f7b6d0 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca898d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587828.869757:0:7276:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788587828.869788:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca897f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1258 expref: 34 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.869816:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1258 expref: 33 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.869823:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033500) 00010000:00010000:0.0:1788587828.869826:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587828.869828:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a800, rc 0) 00000100:00100000:0.0:1788587828.870074:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+34:10470:x1875470026061824:12345-192.168.206.33@tcp:101:bash.0 Request processed in 1851us (2343us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788587828.870083:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 96 00010000:00010000:2.0:1788587828.876312:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca898d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.876329:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca898d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.876337:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca898d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.876343:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587828.876348:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca898d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.876356:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca898d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.876372:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f489033e00) 00010000:00010000:2.0:1788587828.876376:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587828.876380:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca898d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587828.876387:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca898d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587828.881770:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587828.882122:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026061952 00000100:00100000:0.0:1788587828.882132:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026061952 00000100:00080000:2.0:1788587828.882198:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587828.882208:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 34 00000100:00100000:0.0:1788587828.882219:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2345:x1875470026061952:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:0.0:1788587828.882235:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587828.882256:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083f876ed/0xa13e120d54ca89a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db125f expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587828.882282:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587828.882301:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=276s v=(0 0) 00010000:00010000:0.0:1788587828.882305:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587828.882314:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083f876ed/0xa13e120d54ca89a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db125f expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.882333:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083f876ed/0xa13e120d54ca89a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db125f expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.882361:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a400, rc 0) 00000100:00100000:0.0:1788587828.882422:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2345:x1875470026061952:12345-192.168.206.33@tcp:101:bash.0 Request processed in 204us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587828.882429:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 34 00000100:00100000:3.0:1788587828.887384:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587828.887545:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026062080 00000100:00100000:0.0:1788587828.887554:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026062080 00000100:00100000:0.0:1788587828.887606:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 35 00000100:00100000:0.0:1788587828.887626:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:10470:x1875470026062080:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:0.0:1788587828.887642:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587828.887658:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1266 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.887688:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083f876ed/0xa13e120d54ca89a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db125f expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.887696:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587828.887699:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587828.887705:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.887734:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083f876ed/0xa13e120d54ca89a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db125f expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.887749:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083f876ed/0xa13e120d54ca89a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db125f expref: 9 pid: 6695 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587828.887776:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875470043902720:192.168.206.33@tcp:104: 00000100:00100000:0.0:1788587828.889095:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48341ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587828.896549:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587828.896679:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026062208 00000100:00100000:1.0:1788587828.896688:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026062208 00000100:00100000:0.0:1788587828.896691:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875470043902720:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587828.896730:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.896731:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083f876ed/0xa13e120d54ca89a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db125f expref: 10 pid: 6695 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587828.896760:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b600, rc 0) 00000100:00100000:0.0:1788587828.896832:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:10470:x1875470026062080:12345-192.168.206.33@tcp:101:bash.0 Request processed in 9216us (9454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587828.896833:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 49 00000100:00100000:0.0:1788587828.896875:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 35 00000100:00100000:1.0:1788587828.896877:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d6a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:2344:x1875470026062208:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587828.896895:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587828.896917:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083f876ed/0xa13e120d54ca89a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db125f expref: 9 pid: 6695 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.896931:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083f876ed/0xa13e120d54ca89a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db125f expref: 9 pid: 6695 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.896950:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083f876ed/0xa13e120d54ca89a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db125f expref: 9 pid: 6695 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.896975:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587828.896980:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587828.896989:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.897015:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587828.897208:0:6708:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587828.897223:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab6ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6708:1875470043902848:192.168.206.33@tcp:105: 00000100:00100000:1.0:1788587828.897274:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486647540 going to sleep for 11 seconds 00000100:00100000:2.0:1788587828.900780:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587828.901810:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026062464 00000100:00100000:3.0:1788587828.901821:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026062464 00000100:00100000:3.0:1788587828.901903:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 25 00000100:00100000:3.0:1788587828.901913:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:10470:x1875470026062464:12345-192.168.206.33@tcp:35:bash.0 00000100:00100000:3.0:1788587828.902710:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+34:10470:x1875470026062464:12345-192.168.206.33@tcp:35:bash.0 Request processed in 796us (1934us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788587828.902720:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 25 00000100:00100000:1.0:1788587828.903651:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab6ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6708:1875470043902848:192.168.206.33@tcp:105: 00010000:00010000:1.0:1788587828.903675:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587828.903723:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d6a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026062208:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 6880us (7185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587828.903733:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 49 00000100:00100000:2.0:1788587829.071740:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587829.071825:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026062592 00000100:00100000:3.0:1788587829.071834:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026062592 00000100:00100000:3.0:1788587829.071933:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 97 00000100:00100000:3.0:1788587829.071944:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+34:10486:x1875470026062592:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587829.071978:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587829.071998:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca89b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db126d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.072058:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca89b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.072072:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca89b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.072083:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca89b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587829.072226:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788587829.072230:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587829.072248:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca89b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.072276:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca89b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db126d expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.072293:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca89b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db126d expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.072302:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:3.0:1788587829.072305:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587829.072309:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030200, rc 0) 00000100:00080000:2.0:1788587829.072389:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587829.072479:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+35:10486:x1875470026062592:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 535us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587829.072486:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 97 00000100:00100000:3.0:1788587829.075401:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587829.075648:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026062848 00000100:00100000:1.0:1788587829.075658:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026062848 00000100:00100000:1.0:1788587829.075714:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 98 00000100:00100000:1.0:1788587829.075724:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+35:10486:x1875470026062848:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587829.075742:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587829.075759:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca89be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1274 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.076066:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca89c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.076080:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca89c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.076104:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca89c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587829.076220:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788587829.076339:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca89be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1274 expref: 38 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.076357:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca89c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1274 expref: 37 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.076366:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033500) 00010000:00010000:1.0:1788587829.076369:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587829.076384:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1e00, rc 0) 00000100:00100000:1.0:1788587829.076505:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:10486:x1875470026062848:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 782us (1112us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788587829.076512:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 98 00000100:00100000:1.0:1788587829.080512:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587829.080556:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.080636:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026062976 00000100:00100000:0.0:1788587829.080646:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026062976 00000100:00100000:0.0:1788587829.080709:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:0.0:1788587829.080719:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:2345:x1875470026062976:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587829.080734:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587829.080758:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca89c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1274 expref: 37 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.080776:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033500) 00010000:00010000:0.0:1788587829.080781:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587829.080837:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:2345:x1875470026062976:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 119us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587829.080874:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:2.0:1788587829.082965:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026063232 00000100:00100000:2.0:1788587829.082979:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026063232 00000100:00100000:3.0:1788587829.083210:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 99 00000100:00100000:3.0:1788587829.083221:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:10486:x1875470026063232:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587829.083242:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587829.083260:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca89d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db127b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.083343:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca89da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.083357:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca89da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.083368:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca89da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587829.083380:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788587829.083560:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca89d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db127b expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.083575:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca89da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db127b expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.083584:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033500) 00010000:00010000:3.0:1788587829.083586:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788587829.083590:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031200, rc 0) 00000100:00100000:3.0:1788587829.083657:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+38:10486:x1875470026063232:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 438us (3101us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788587829.083664:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 99 00000100:00100000:1.0:1788587829.095150:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.095321:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026063360 00000100:00100000:0.0:1788587829.095330:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026063360 00000100:00100000:0.0:1788587829.095381:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 36 00000100:00100000:0.0:1788587829.095391:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026063360:12345-192.168.206.33@tcp:1:lfs.0 00010000:00010000:0.0:1788587829.095440:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d382f5/0xa13e120d54ca89e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.095460:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.095469:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587829.095473:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587829.095478:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093d382f5/0xa13e120d54ca89e8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.095511:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.095525:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 8 pid: 6693 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587829.095537:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1875470043902976:192.168.206.33@tcp:104: 00000100:00100000:0.0:1788587829.095643:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48341ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587829.099138:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.099247:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1875470043902976:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587829.099280:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000093d382f5/0xa13e120d54ca89e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587829.099567:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026063488 00000100:00100000:3.0:1788587829.099574:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026063488 00002000:00100000:3.0:1788587829.099630:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff88f4bf6fad80 x1875470026063488/t0(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:390/0 lens 504/0 e 0 to 0 dl 1788587840 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587829.099640:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4bf6fad80 with x1875470026063488 ext(0->8) 00010000:00010000:3.0:1788587829.099647:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 9 pid: 6693 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.099660:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 9 pid: 6693 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587829.099667:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88f4bf6fad80 00000100:00100000:3.0:1788587829.099736:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 1 00000100:00100000:3.0:1788587829.099746:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2344:x1875470026063488:12345-192.168.206.33@tcp:4:lfs.0 00000100:00100000:3.0:1788587829.100237:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+11:2344:x1875470026063488:12345-192.168.206.33@tcp:4:lfs.0 Request processed in 490us (1107us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788587829.100246:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 1 00002000:00100000:3.0:1788587829.100254:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff88f4bf6fad80 x1875470026063488/t4294967302(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:390/0 lens 504/448 e 0 to 0 dl 1788587840 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587829.100263:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4bf6fad80 with x1875470026063488 ext(0->8) 00010000:00010000:3.0:1788587829.100269:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 11 pid: 6693 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.100281:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 11 pid: 6693 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587829.100300:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88f4bf6fad80 00000100:00100000:3.0:1788587829.104151:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587829.106049:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026063616 00000100:00100000:2.0:1788587829.106068:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026063616 00010000:00010000:2.0:1788587829.106191:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 11 pid: 6693 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587829.106248:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 50 00000100:00100000:2.0:1788587829.106262:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1941180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+11:2347:x1875470026063616:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587829.106285:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788587829.106309:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788587829.106313:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788587827 00002000:00010000:2.0:1788587829.106316:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788587827 00002000:00010000:2.0:1788587829.106319:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788587827 00010000:00010000:2.0:1788587829.106326:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 11 pid: 6693 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587829.106467:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 11 pid: 6693 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587829.106499:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca89a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1266 expref: 11 pid: 6693 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587829.106544:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587829.106550:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587829.106557:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093d382f5/0xa13e120d54ca89e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587829.106568:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093d382f5/0xa13e120d54ca89e8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587829.106680:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587829.106773:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1941180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:2347:x1875470026063616:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 513us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587829.106781:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 50 00010000:00010000:0.0:1788587829.107548:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000093d382f5/0xa13e120d54ca89e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.107567:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093d382f5/0xa13e120d54ca89e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.107606:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d382f5/0xa13e120d54ca89e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.107627:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093d382f5/0xa13e120d54ca89e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.107636:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093d382f5/0xa13e120d54ca89e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.107644:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:0.0:1788587829.107649:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d382f5/0xa13e120d54ca89e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.107658:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d382f5/0xa13e120d54ca89e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.107675:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093d382f5/0xa13e120d54ca89e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.107704:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093d382f5/0xa13e120d54ca89e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587829.107797:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2344:x1875470026063360:12345-192.168.206.33@tcp:1:lfs.0 Request processed in 12405us (12652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587829.107808:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 36 00000100:00100000:1.0:1788587829.110392:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.110543:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026063872 00000100:00100000:0.0:1788587829.110558:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026063872 00000100:00100000:0.0:1788587829.110647:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 26 00000100:00100000:0.0:1788587829.110661:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f483774450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+38:10486:x1875470026063872:12345-192.168.206.33@tcp:35:lfs.0 00000004:00010000:0.0:1788587829.110743:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca89da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db127b expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587829.111224:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788587829.111276:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788587829.113807:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788587829.113985:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.114012:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8994 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1258 expref: 42 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.114023:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.114091:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1258 expref: 42 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.114140:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1258 expref: 42 pid: 7276 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587829.114159:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf724700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875470043903104:192.168.206.33@tcp:104: 00000100:00100000:0.0:1788587829.114297:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48341c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587829.117303:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587829.117400:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026064000 00000100:00100000:1.0:1788587829.117413:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026064000 00010000:00010000:1.0:1788587829.117462:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8994 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1258 expref: 43 pid: 7276 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587829.117509:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 51 00000100:00100000:1.0:1788587829.117521:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1942d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+43:2345:x1875470026064000:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587829.117557:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587829.117566:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8994 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1258 expref: 43 pid: 7276 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.117583:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1258 expref: 43 pid: 7276 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.117610:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033500) 00010000:00010000:1.0:1788587829.117629:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.117641:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.117651:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.117676:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587829.117746:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1942d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+43:2345:x1875470026064000:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 227us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587829.117754:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 51 00010000:00010000:0.0:1788587829.117778:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8994 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1258 expref: 42 pid: 7276 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587829.117801:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf724700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875470043903104:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587829.117828:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.117838:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.118156:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587829.118380:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788587829.119904:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788587829.120728:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf724700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875470043903232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788587829.120821:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587829.120900:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4eca6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587829.121107:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043903232 00000100:00100000:1.0:1788587829.121117:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043903232 00000100:00100000:1.0:1788587829.121189:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587829.121200:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1875470043903232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788587829.121351:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1875470043903232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 152us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587829.121361:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587829.122333:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf724700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875470043903232:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788587829.123412:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788587829.123531:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf724700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875470043903360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788587829.123940:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587829.124034:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f493590780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587829.124381:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043903360 00000100:00100000:1.0:1788587829.124391:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043903360 00000100:00100000:1.0:1788587829.124493:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587829.124505:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1875470043903360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788587829.124937:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5845:x1875470043903360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 432us (1096us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788587829.124946:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587829.125395:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf724700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875470043903360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788587829.126161:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788587829.126304:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.126317:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.126324:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.126330:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77aa00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587829.126335:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.126343:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.126361:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033500) 00010000:00010000:0.0:1788587829.126364:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788587829.126369:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.126375:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788587829.127361:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788587829.127544:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1788587829.129933:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 276385086067ns, next at 277382712841ns, rc = 0 00000001:00080000:0.0:1788587829.129990:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788587829.130258:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033500) 00010000:00010000:0.0:1788587829.130264:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788587829.130278:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca89da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db127b expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587829.131235:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f483774450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+45:10486:x1875470026063872:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 20568us (20851us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788587829.131256:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 26 00000020:00080000:0.0:1788587829.131263:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788587829.136394:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.136998:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026064128 00000100:00100000:0.0:1788587829.137014:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026064128 00000100:00100000:0.0:1788587829.137222:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 100 00000100:00100000:0.0:1788587829.137236:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+45:10486:x1875470026064128:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587829.137270:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587829.137302:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1282 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.137397:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1282 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.137430:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1282 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.137455:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:0.0:1788587829.137458:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587829.137462:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77aa00, rc 0) 00000100:00100000:0.0:1788587829.137545:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+46:10486:x1875470026064128:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 311us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587829.137571:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 100 00000100:00100000:3.0:1788587829.142928:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.143107:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026064384 00000100:00100000:0.0:1788587829.143120:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026064384 00000100:00100000:0.0:1788587829.143194:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 27 00000100:00100000:0.0:1788587829.143206:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+46:10486:x1875470026064384:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:0.0:1788587829.143530:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+47:10486:x1875470026064384:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 326us (615us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788587829.143539:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 27 00000100:00100000:0.0:1788587829.192449:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587829.193208:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf6f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043903488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587829.193283:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587829.193542:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043903488 00000100:00100000:3.0:1788587829.193557:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043903488 00000100:00100000:3.0:1788587829.193656:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788587829.193669:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3303:x1875470043903488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587829.193703:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587829.193788:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3303:x1875470043903488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587829.193797:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788587829.193959:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf6f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043903488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587829.241478:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587829.241603:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026064512 00000100:00100000:3.0:1788587829.241626:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026064512 00000100:00100000:3.0:1788587829.242139:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 101 00000100:00100000:3.0:1788587829.242154:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+47:10496:x1875470026064512:12345-192.168.206.33@tcp:34:lfs.0 00010000:00010000:3.0:1788587829.242317:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca89fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.242498:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca89fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.242516:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca89fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.242537:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8a04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.242561:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.242568:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.242702:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.242711:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.242718:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587829.242781:0:8471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.242796:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca89fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.242804:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca89fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.242811:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca89fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.242817:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587829.242822:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca89fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.242831:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca89fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.242876:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:3.0:1788587829.242879:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587829.243186:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca89fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243197:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca89fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243214:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243221:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8a04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243227:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8a04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243233:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587829.243236:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8a04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243242:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8a04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243251:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f484d44100) 00010000:00010000:3.0:1788587829.243254:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587829.243257:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8a04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243264:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8a04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243296:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243302:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243308:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243313:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587829.243315:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243321:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243329:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:3.0:1788587829.243331:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587829.243334:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.243340:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587829.243448:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+47:10496:x1875470026064512:12345-192.168.206.33@tcp:34:lfs.0 Request processed in 1295us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587829.243458:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 101 00000100:00100000:3.0:1788587829.286755:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.287200:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026064768 00000100:00100000:0.0:1788587829.287214:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026064768 00000100:00100000:0.0:1788587829.287295:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 102 00000100:00100000:0.0:1788587829.287308:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+47:10499:x1875470026064768:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587829.287333:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587829.287432:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1289 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.287528:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.287546:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.287559:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.287599:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8a20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.287608:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.287626:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.287773:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8a27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.287782:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.287789:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587829.287801:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788587829.288267:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288277:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288284:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288290:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587829.288295:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288316:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288331:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:0.0:1788587829.288334:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587829.288340:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288348:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288366:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288372:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8a20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288506:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288512:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587829.288515:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288522:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8a20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288530:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f489033500) 00010000:00010000:0.0:1788587829.288532:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587829.288535:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8a20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288550:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8a20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288607:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1289 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288708:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8a27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1289 expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.288716:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:0.0:1788587829.288719:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587829.288721:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b600, rc 0) 00000100:00100000:0.0:1788587829.289601:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+49:10499:x1875470026064768:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 2289us (2851us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788587829.289612:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 102 00000100:00100000:2.0:1788587829.296280:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.296529:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026064896 00000100:00100000:0.0:1788587829.296542:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026064896 00000100:00100000:0.0:1788587829.296661:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 103 00000100:00100000:0.0:1788587829.296674:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+49:10499:x1875470026064896:12345-192.168.206.33@tcp:54:lfs.0 00010000:00010000:0.0:1788587829.296765:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.296786:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.296801:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.296886:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.296895:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.296902:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.296909:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587829.296914:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.296922:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.296947:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:0.0:1788587829.296952:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587829.296958:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.296965:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587829.297113:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+49:10499:x1875470026064896:12345-192.168.206.33@tcp:54:lfs.0 Request processed in 440us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587829.297121:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 103 00000100:00100000:2.0:1788587829.300185:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.300266:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026065152 00000100:00100000:0.0:1788587829.300278:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026065152 00000100:00100000:0.0:1788587829.300350:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 28 00000100:00100000:0.0:1788587829.300377:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+49:10499:x1875470026065152:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:0.0:1788587829.301097:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+50:10499:x1875470026065152:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 718us (981us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788587829.301119:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 28 00000100:00100000:3.0:1788587829.367564:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587829.367731:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026065408 00000100:00100000:1.0:1788587829.367744:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026065408 00000100:00100000:1.0:1788587829.367910:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 104 00000100:00100000:1.0:1788587829.367923:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+50:10509:x1875470026065408:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:1.0:1788587829.367957:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587829.367961:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788587829.367998:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca89b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db126d expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.368026:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:1.0:1788587829.368032:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587829.368049:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca8a3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1290 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.368176:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.368193:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8a27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1289 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.368225:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.368268:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8a27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1289 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.368284:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8a27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1289 expref: 50 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587829.368301:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab6d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8471:1875470043903616:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587829.368422:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4866473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587829.371221:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.371505:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026065536 00000100:00100000:0.0:1788587829.371517:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026065536 00010000:00010000:0.0:1788587829.371570:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8a27 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1289 expref: 51 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587829.371627:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 52 00000100:00100000:0.0:1788587829.371639:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+51:2345:x1875470026065536:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587829.371658:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587829.371666:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8a27 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1289 expref: 51 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.371681:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8a27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1289 expref: 51 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.371707:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:0.0:1788587829.371713:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.371723:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.371732:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.371768:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587829.371835:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+51:2345:x1875470026065536:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 198us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587829.371869:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 52 00010000:00010000:1.0:1788587829.372572:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8a27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1289 expref: 50 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587829.372598:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab6d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8471:1875470043903616:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587829.372638:0:8471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.372650:0:8471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.372666:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587829.372690:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788587829.373147:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca8a3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1290 expref: 51 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.373187:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1290 expref: 50 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.373197:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:1.0:1788587829.373200:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788587829.373203:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0c00, rc 0) 00000100:00100000:1.0:1788587829.373326:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+50:10509:x1875470026065408:12345-192.168.206.33@tcp:101:bash.0 Request processed in 5406us (5775us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788587829.373359:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 104 00000100:00100000:2.0:1788587829.376779:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.377144:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026065792 00000100:00100000:0.0:1788587829.377157:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026065792 00000100:00100000:0.0:1788587829.377268:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 105 00000100:00100000:0.0:1788587829.377281:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+50:10509:x1875470026065792:12345-192.168.206.33@tcp:36:bash.0 00010000:00010000:0.0:1788587829.377641:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.377663:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.377679:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587829.377744:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788587829.377775:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006eeac446 reply state 000000002064da57 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587829.377785:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587829.377960:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+53:10509:x1875470026065792:12345-192.168.206.33@tcp:36:bash.0 Request processed in 681us (1195us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788587829.377969:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 105 00000020:00080000:0.0:1788587829.377975:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788587829.380749:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.380773:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.380781:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.380788:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587829.380794:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.380804:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.380826:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:1.0:1788587829.380830:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587829.380836:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.381037:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8a51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587829.381065:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.381141:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026065920 00000100:00100000:0.0:1788587829.381154:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026065920 00000100:00100000:0.0:1788587829.381223:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 106 00000100:00100000:0.0:1788587829.381242:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+52:10509:x1875470026065920:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:0.0:1788587829.381271:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587829.381292:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8a58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1297 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.381422:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.381438:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1290 expref: 53 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.381447:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.381491:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1290 expref: 53 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.381506:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1290 expref: 53 pid: 8471 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587829.381522:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf727b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043903744:192.168.206.33@tcp:104: 00000100:00100000:0.0:1788587829.381773:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48341c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788587829.386326:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.386552:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf727b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043903744:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587829.386587:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587829.386737:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026066048 00000100:00100000:2.0:1788587829.386746:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026066048 00010000:00010000:2.0:1788587829.386790:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1290 expref: 54 pid: 8471 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587829.386832:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 53 00000100:00100000:2.0:1788587829.386980:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:2344:x1875470026066048:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587829.387007:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587829.387016:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1290 expref: 54 pid: 8471 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587829.387050:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1290 expref: 54 pid: 8471 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587829.387079:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca8a43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1290 expref: 54 pid: 8471 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587829.387099:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:2.0:1788587829.387105:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587829.388192:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587829.388203:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587829.388255:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587829.388345:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+53:2344:x1875470026066048:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 1501us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587829.388356:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 53 00010000:00010000:3.0:1788587829.389883:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.389910:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587829.389991:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788587829.389997:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587829.390030:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.390085:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8a58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1297 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.390124:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1297 expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.390135:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:3.0:1788587829.390139:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587829.390143:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b000, rc 0) 00000100:00100000:3.0:1788587829.390236:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+52:10509:x1875470026065920:12345-192.168.206.33@tcp:101:bash.0 Request processed in 8995us (9175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587829.390245:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 106 00000100:00100000:3.0:1788587829.392723:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587829.393338:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026066304 00000100:00100000:1.0:1788587829.393353:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026066304 00000100:00100000:1.0:1788587829.393523:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 29 00000100:00100000:1.0:1788587829.393536:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+52:10509:x1875470026066304:12345-192.168.206.33@tcp:35:bash.0 00000100:00100000:1.0:1788587829.393880:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+53:10509:x1875470026066304:12345-192.168.206.33@tcp:35:bash.0 Request processed in 345us (1169us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788587829.393888:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 29 00000100:00100000:2.0:1788587829.457437:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587829.457523:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026066432 00000100:00100000:1.0:1788587829.457533:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026066432 00000100:00100000:1.0:1788587829.457591:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 107 00000100:00100000:1.0:1788587829.457601:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+53:10515:x1875470026066432:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587829.457635:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587829.457656:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8a66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db129e expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.457732:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8a6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.457747:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8a6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.457759:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8a6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587829.457791:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788587829.457807:0:8471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587829.457826:0:8471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8a6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.457890:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8a66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db129e expref: 55 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.457907:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8a6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db129e expref: 54 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587829.457916:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:1.0:1788587829.457919:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587829.457922:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1400, rc 0) 00000100:00100000:1.0:1788587829.457992:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:10515:x1875470026066432:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 392us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587829.457999:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 107 00000100:00100000:2.0:1788587829.463718:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.463834:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026066560 00000100:00100000:0.0:1788587829.463868:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026066560 00000100:00100000:0.0:1788587829.463935:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 108 00000100:00100000:0.0:1788587829.463944:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:10515:x1875470026066560:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587829.463963:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587829.463983:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8a74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db12a5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464044:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8a7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464059:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464071:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464086:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8a82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464093:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464100:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464334:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8a89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464344:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464352:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587829.464400:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788587829.464405:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587829.464422:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464435:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464443:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464450:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8a7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464458:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464464:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587829.464468:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464476:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8a7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464489:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:0.0:1788587829.464492:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587829.464498:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8a7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464505:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8a7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464532:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464538:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8a82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464544:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464550:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587829.464553:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464559:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8a82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464567:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f489033500) 00010000:00010000:0.0:1788587829.464570:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587829.464573:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8a82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464579:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8a82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464608:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8a74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12a5 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464633:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8a89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12a5 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.464654:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:0.0:1788587829.464656:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587829.464659:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77ae00, rc 0) 00000100:00100000:0.0:1788587829.467182:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10515:x1875470026066560:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 3228us (3462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587829.467193:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 108 00000100:00100000:3.0:1788587829.469321:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.469470:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026066688 00000100:00100000:0.0:1788587829.469479:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026066688 00000100:00100000:0.0:1788587829.469539:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:0.0:1788587829.469549:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:2345:x1875470026066688:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587829.469563:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587829.469586:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8a89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12a5 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.469608:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:0.0:1788587829.469623:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587829.469674:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:2345:x1875470026066688:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 127us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587829.469681:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:2.0:1788587829.472347:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587829.472673:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026066944 00000100:00100000:3.0:1788587829.472691:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026066944 00000100:00100000:3.0:1788587829.473038:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 109 00000100:00100000:3.0:1788587829.473052:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:10515:x1875470026066944:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587829.473211:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587829.473240:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8a90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db12ac expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.473372:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.473402:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1297 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.474051:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.474278:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1297 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.474299:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1297 expref: 55 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587829.474318:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa91880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043903872:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587829.476210:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf713240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587829.481051:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.481162:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026067072 00000100:00100000:0.0:1788587829.481178:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026067072 00010000:00010000:0.0:1788587829.481230:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1297 expref: 56 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587829.481285:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 54 00000100:00100000:0.0:1788587829.481300:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+56:2344:x1875470026067072:12345-192.168.206.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788587829.481335:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa91880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043903872:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587829.481335:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587829.481351:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1297 expref: 56 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.481370:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1297 expref: 56 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.481700:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.486110:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8a5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1297 expref: 56 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.486138:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:0.0:1788587829.486144:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.486153:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.486160:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.486202:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587829.486335:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:2344:x1875470026067072:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 5038us (5298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587829.486347:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 54 00010000:00010000:3.0:1788587829.486478:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.486487:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587829.486525:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788587829.486688:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8a90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12ac expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.486716:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12ac expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587829.486724:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:3.0:1788587829.486727:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788587829.486730:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031000, rc 0) 00000100:00100000:3.0:1788587829.486754:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10515:x1875470026066944:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 13707us (14416us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788587829.486760:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 109 00000100:00100000:1.0:1788587829.496209:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.496306:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026067328 00000100:00100000:0.0:1788587829.496322:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026067328 00000100:00100000:0.0:1788587829.496409:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 8 00000100:00100000:0.0:1788587829.496421:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10515:x1875470026067328:12345-192.168.206.33@tcp:103:lfs.0 00010000:00010000:0.0:1788587829.496451:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587829.496478:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca89f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1282 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.496500:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:0.0:1788587829.496505:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587829.496575:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:10515:x1875470026067328:12345-192.168.206.33@tcp:103:lfs.0 Request processed in 157us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587829.496582:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 8 00000100:00100000:2.0:1788587829.501415:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.501501:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026067456 00000100:00100000:0.0:1788587829.501511:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026067456 00000100:00100000:0.0:1788587829.501565:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 110 00000100:00100000:0.0:1788587829.501576:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:10515:x1875470026067456:12345-192.168.206.33@tcp:58:lfs.0 00010000:00010000:0.0:1788587829.501713:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8aa5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.501729:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8aa5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.501741:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8aa5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587829.502097:0:7276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788587829.502171:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:10515:x1875470026067456:12345-192.168.206.33@tcp:58:lfs.0 Request processed in 596us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587829.502179:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 110 00000100:00100000:1.0:1788587829.505829:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587829.506034:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026067584 00000100:00100000:0.0:1788587829.506048:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026067584 00000100:00100000:0.0:1788587829.506170:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 111 00000100:00100000:0.0:1788587829.506181:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:10515:x1875470026067584:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587829.506208:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587829.506236:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca8aac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db12b3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.506332:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8aa5 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.506350:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca8aac lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12b3 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.506378:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8aa5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.506393:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca8aac lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12b3 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.506410:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:0.0:1788587829.506414:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587829.506418:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca8aac lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12b3 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587829.506439:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77aa00, rc 0) 00000100:00100000:0.0:1788587829.506524:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10515:x1875470026067584:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 345us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587829.506532:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 111 00010000:00010000:0.0:1788587829.709245:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587830.216994:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043904256:0@lo:400:kworker.0 00000100:00100000:0.0:1788587830.217088:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587830.217185:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788587830.217193:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043904128:0@lo:400:kworker.0 00000100:00100000:0.0:1788587830.217241:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587830.217266:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043904640:0@lo:400:kworker.0 00000100:00100000:0.0:1788587830.217296:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587830.217536:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043904640 00000100:00100000:0.0:1788587830.217547:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043904640 00000100:00100000:0.0:1788587830.217813:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788587830.217825:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875470043904640:12345-0@lo:400:kworker.0 00000040:00080000:1.0:1788587830.218417:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587830.218427:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587830.218486:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788587830.218493:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587830.218631:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf5e4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875470043904768:192.168.206.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788587830.218725:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486647e40 going to sleep for 11 seconds 00000100:00080000:2.0:1788587830.218756:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587830.218762:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043904000:0@lo:400:kworker.0 00000100:00100000:2.0:1788587830.218819:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043904256 00000100:00100000:2.0:1788587830.218829:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043904256 00000100:00100000:2.0:1788587830.218929:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043904128 00000100:00100000:2.0:1788587830.218935:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043904128 00000004:00080000:3.0:1788587830.218947:0:7954:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 277474102933ns, next at 278474099440ns, rc = 0 00000100:00100000:2.0:1788587830.218968:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788587830.218977:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043904384:0@lo:400:kworker.0 00000100:00100000:2.0:1788587830.218983:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043904256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587830.219129:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875470043904640:12345-0@lo:400:kworker.0 Request processed in 1305us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587830.219139:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788587830.219251:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587830.219302:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875470043904512:0@lo:400:kworker.0 00000100:00100000:1.0:1788587830.219345:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587830.219384:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043904000 00000100:00100000:1.0:1788587830.219390:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043904000 00000100:00100000:1.0:1788587830.219430:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788587830.219439:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3303:x1875470043904000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587830.219486:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3303:x1875470043904000:12345-0@lo:400:kworker.0 Request processed in 48us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587830.219493:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788587830.219541:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043904000:0@lo:400:kworker.0 00000100:00100000:1.0:1788587830.219564:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043904512 00000100:00100000:1.0:1788587830.219568:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043904512 00000100:00100000:1.0:1788587830.219591:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788587830.219598:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043904128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587830.219642:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043904128:12345-0@lo:400:kworker.0 Request processed in 44us (2400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587830.219648:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788587830.219663:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788587830.219669:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875470043904512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587830.219700:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875470043904512:12345-0@lo:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587830.219706:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788587830.219729:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875470043904512:0@lo:400:kworker.0 00000100:00100000:1.0:1788587830.219776:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587830.219785:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043904896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587830.219811:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788587830.222690:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587830.222722:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043904896 00000100:00100000:1.0:1788587830.222732:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043904896 00000100:00100000:3.0:1788587830.225238:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587830.225374:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043904256:12345-0@lo:400:kworker.0 Request processed in 6386us (8275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587830.225392:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788587830.225483:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788587830.225503:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043904896:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587830.225526:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043904128:0@lo:400:kworker.0 00000100:00100000:2.0:1788587830.225551:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043904640:0@lo:400:kworker.0 00000100:00100000:2.0:1788587830.225565:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043904256:0@lo:400:kworker.0 00000100:00100000:2.0:1788587830.225638:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043904384 00000100:00100000:2.0:1788587830.225646:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043904384 00002000:00000024:1.0:1788587830.225896:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587830.225976:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043904896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 481us (6163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587830.225984:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788587830.226041:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043904896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587830.226118:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf5e4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875470043904768:192.168.206.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788587830.226295:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587830.226315:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026067712 00000100:00100000:1.0:1788587830.226321:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026067712 00000100:00100000:1.0:1788587830.226354:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 112 00000100:00100000:1.0:1788587830.226362:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10516:x1875470026067712:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788587830.226381:0:8471:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788587830.226460:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10516:x1875470026067712:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 Request processed in 99us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587830.226466:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 112 00000100:00080000:0.0:1788587830.227018:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587830.228027:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788587830.228050:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3302:x1875470043904384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587830.228524:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3302:x1875470043904384:12345-0@lo:400:kworker.0 Request processed in 483us (3292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587830.228535:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788587830.232088:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043904384:0@lo:400:kworker.0 00000100:00100000:0.0:1788587830.247127:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587830.247295:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026067840 00000100:00100000:2.0:1788587830.247305:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026067840 00000100:00100000:2.0:1788587830.247361:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 113 00000100:00100000:2.0:1788587830.247371:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10516:x1875470026067840:12345-192.168.206.33@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788587830.247437:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8ab3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247468:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247482:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247498:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8aba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247505:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8aba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247511:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8aba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247532:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ac1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247553:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247560:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587830.247596:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788587830.247600:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587830.247623:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247634:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247652:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8ab3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247659:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8ab3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247666:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159de00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587830.247670:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8ab3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247677:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8ab3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247691:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44800) 00010000:00010000:2.0:1788587830.247694:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587830.247698:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8ab3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247703:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8ab3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247716:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8aba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247721:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8aba lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247728:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8aba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247733:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587830.247740:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8aba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247746:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8aba lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247754:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff88f488834800) 00010000:00010000:2.0:1788587830.247756:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587830.247759:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8aba lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247763:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8aba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247777:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247782:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247798:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247804:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587830.247807:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247813:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247820:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:2.0:1788587830.247822:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587830.247831:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ac1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.247837:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ac1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587830.247960:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10516:x1875470026067840:12345-192.168.206.33@tcp:34:lhsmtool_posix.0 Request processed in 589us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587830.247968:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 113 00000100:00100000:0.0:1788587830.253216:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587830.253321:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026068096 00000100:00100000:1.0:1788587830.253331:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026068096 00000100:00100000:1.0:1788587830.253391:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 114 00000100:00100000:1.0:1788587830.253401:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:10516:x1875470026068096:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587830.253421:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587830.253441:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8ac8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db12ba expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.253680:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8acf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.253694:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8acf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.253704:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8acf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587830.253716:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788587830.253820:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8acf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.253828:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8acf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.253834:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8acf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.253875:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587830.253881:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8acf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.253888:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8acf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.253900:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:1.0:1788587830.253903:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788587830.253908:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8acf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.253925:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8acf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.253966:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8ac8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12ba expref: 57 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.253976:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44800) 00010000:00010000:1.0:1788587830.253979:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587830.253983:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8ac8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12ba expref: 57 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.253993:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0200, rc 0) 00000100:00100000:1.0:1788587830.254042:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+56:10516:x1875470026068096:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 643us (836us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788587830.254050:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 114 00000100:00100000:0.0:1788587830.258802:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587830.258964:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026068224 00000100:00100000:2.0:1788587830.258974:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026068224 00000100:00100000:2.0:1788587830.259032:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 115 00000100:00100000:2.0:1788587830.259042:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+56:10516:x1875470026068224:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788587830.259080:0:7276:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587830.259189:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+56:10516:x1875470026068224:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 Request processed in 148us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587830.259196:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 115 00000100:00100000:0.0:1788587830.265652:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587830.265743:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026068480 00000100:00100000:3.0:1788587830.265761:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026068480 00000100:00100000:3.0:1788587830.265898:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 116 00000100:00100000:3.0:1788587830.265914:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+56:10516:x1875470026068480:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587830.265944:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587830.265949:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788587830.265985:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8a6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db129e expref: 56 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.266033:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:3.0:1788587830.266039:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587830.266678:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8add lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db12c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587830.267161:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788587830.267343:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ae4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.267357:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.267369:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.267442:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8add lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12c1 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.267460:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12c1 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.267468:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88f488834800) 00010000:00010000:2.0:1788587830.267471:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587830.267475:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d800, rc 0) 00000100:00100000:2.0:1788587830.267539:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+57:10516:x1875470026068480:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 1630us (1895us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788587830.267548:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 116 00000100:00100000:3.0:1788587830.274560:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587830.274778:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026068736 00000100:00100000:1.0:1788587830.274793:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026068736 00000100:00100000:1.0:1788587830.274887:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 117 00000100:00100000:1.0:1788587830.274897:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+57:10516:x1875470026068736:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788587830.274949:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587830.274972:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ae4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12c1 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.274991:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88f488834800) 00010000:00010000:1.0:1788587830.275003:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587830.275023:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8af2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275052:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8af2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275062:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8af2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275076:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8af9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x1b494f1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275083:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8af9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1b494f1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275089:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8af9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1b494f1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275148:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8af2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275155:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8af2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275161:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8af2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275166:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587830.275170:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8af2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275178:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8af2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275186:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:1.0:1788587830.275194:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587830.275198:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8af2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275205:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8af2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275216:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8af9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1b494f1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275222:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8af9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1b494f1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275228:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8af9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1b494f1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275234:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587830.275237:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8af9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1b494f1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275243:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8af9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1b494f1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275251:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x1b494f1d (ffff88f48fa37300) 00010000:00010000:1.0:1788587830.275253:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587830.275256:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8af9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1b494f1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.275262:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8af9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1b494f1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587830.275334:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+56:10516:x1875470026068736:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 437us (789us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587830.275346:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 117 00000100:00100000:0.0:1788587830.278431:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587830.278652:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026068864 00000100:00100000:2.0:1788587830.278666:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026068864 00000100:00100000:2.0:1788587830.278728:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 118 00000100:00100000:2.0:1788587830.278737:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+56:10516:x1875470026068864:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587830.278754:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587830.278777:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8b00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db12c8 expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.278810:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8b07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.278823:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.278834:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.278953:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8b00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12c8 expref: 58 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.278972:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12c8 expref: 57 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.278980:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88f488834100) 00010000:00010000:2.0:1788587830.278983:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587830.278987:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d400, rc 0) 00000100:00100000:2.0:1788587830.279050:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+57:10516:x1875470026068864:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 314us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587830.279057:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 118 00000100:00100000:0.0:1788587830.281350:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587830.281436:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026069120 00000100:00100000:2.0:1788587830.281445:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026069120 00000100:00100000:2.0:1788587830.281500:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 119 00000100:00100000:2.0:1788587830.281508:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+57:10516:x1875470026069120:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587830.281634:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.281651:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.281662:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587830.281942:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1788587830.282028:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebba98d9 reply state 000000008203677d transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587830.282044:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587830.282140:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:10516:x1875470026069120:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 631us (798us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788587830.282147:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 119 00010000:00010000:2.0:1788587830.284348:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.284365:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.284373:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.284379:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159dc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587830.284383:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.284391:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.284408:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88f488834100) 00010000:00010000:2.0:1788587830.284411:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788587830.284415:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.284421:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587830.284723:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587830.284783:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026069248 00000100:00100000:1.0:1788587830.284804:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026069248 00000100:00100000:1.0:1788587830.284891:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 120 00000100:00100000:1.0:1788587830.284900:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+58:10516:x1875470026069248:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587830.284921:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587830.284936:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca8b15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db12cf expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.284989:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca8b15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12cf expref: 59 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.285002:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca8b15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12cf expref: 59 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.285021:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88f488834100) 00010000:00010000:1.0:1788587830.285023:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587830.285026:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0000, rc 0) 00000100:00100000:1.0:1788587830.285081:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:10516:x1875470026069248:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 182us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587830.285088:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 120 00000100:00100000:1.0:1788587830.287907:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587830.287996:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026069376 00000100:00100000:2.0:1788587830.288011:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026069376 00000100:00100000:2.0:1788587830.288110:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 37 00000100:00100000:2.0:1788587830.288121:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2347:x1875470026069376:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788587830.288426:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2347:x1875470026069376:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 Request processed in 306us (536us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788587830.288433:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 37 00000100:00080000:0.0:1788587830.288620:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587830.294664:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587830.294768:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026069632 00000100:00100000:3.0:1788587830.294782:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026069632 00000100:00100000:3.0:1788587830.294903:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 30 00000100:00100000:3.0:1788587830.294918:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:10516:x1875470026069632:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788587830.295496:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+60:10516:x1875470026069632:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 Request processed in 571us (836us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788587830.295509:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 30 00000100:00100000:3.0:1788587830.302035:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587830.302158:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026069888 00000100:00100000:1.0:1788587830.302172:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026069888 00000100:00100000:1.0:1788587830.302251:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 121 00000100:00100000:1.0:1788587830.302277:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+60:10516:x1875470026069888:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788587830.302460:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+60:10516:x1875470026069888:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 198us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587830.302469:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 121 00000100:00100000:0.0:1788587830.305365:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587830.305661:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026070016 00000100:00100000:2.0:1788587830.305674:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026070016 00000100:00100000:2.0:1788587830.305751:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 122 00000100:00100000:2.0:1788587830.305762:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+60:10516:x1875470026070016:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587830.305788:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587830.305817:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db12d6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.305986:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8b23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.306005:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.306020:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587830.306069:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587830.306094:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.306154:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12d6 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.306177:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8b23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12d6 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.306187:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88f488834100) 00010000:00010000:2.0:1788587830.306191:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788587830.306195:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159de00, rc 0) 00000100:00100000:2.0:1788587830.306280:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+61:10516:x1875470026070016:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 519us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587830.306288:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 122 00000100:00100000:0.0:1788587830.310681:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587830.310813:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026070144 00000100:00100000:2.0:1788587830.310826:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026070144 00000100:00100000:2.0:1788587830.310938:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 38 00000100:00100000:2.0:1788587830.310949:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2345:x1875470026070144:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587830.310974:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587830.310999:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca8b2a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db12dd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587830.311034:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9baf35, blocks: 0x1 00010000:00010000:2.0:1788587830.311057:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1788587830.311083:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587830.311094:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca8b2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12dd expref: 10 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.311147:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca8b2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12dd expref: 10 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.311162:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159ce00, rc 0) 00000100:00100000:2.0:1788587830.311221:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:2345:x1875470026070144:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 274us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587830.311229:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 38 00000100:00100000:3.0:1788587830.320061:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587830.320688:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026070400 00000100:00100000:2.0:1788587830.320703:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026070400 00000100:00100000:2.0:1788587830.320784:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 123 00000100:00100000:2.0:1788587830.320797:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+61:10516:x1875470026070400:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788587830.320988:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+61:10516:x1875470026070400:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 193us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587830.320998:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 123 00000100:00100000:0.0:1788587830.324127:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587830.324543:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026070528 00000100:00100000:3.0:1788587830.324557:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026070528 00000100:00100000:3.0:1788587830.324638:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 39 00000100:00100000:3.0:1788587830.324650:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:10516:x1875470026070528:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587830.324675:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587830.324700:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e7bc4fd/0xa13e120d54ca8b31 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db12e4 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.324745:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca8b2a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12dd expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.324756:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587830.324761:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587830.324767:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e7bc4fd/0xa13e120d54ca8b31 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12e4 expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.324889:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca8b2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12dd expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.324908:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca8b2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12dd expref: 11 pid: 6695 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587830.324926:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6694:1875470043905024:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587830.325062:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf713240 going to sleep for 11 seconds 00000100:00100000:3.0:1788587830.331339:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6694:1875470043905024:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587830.331401:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005e7bc4fd/0xa13e120d54ca8b31 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12e4 expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.331546:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031800, rc 0) 00000100:00100000:3.0:1788587830.331642:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+11:10516:x1875470026070528:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 6994us (7539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587830.331654:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 39 00000100:00100000:0.0:1788587830.334949:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587830.335054:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026070656 00000100:00100000:2.0:1788587830.335070:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026070656 00010000:00010000:2.0:1788587830.335143:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca8b2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12dd expref: 11 pid: 6695 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587830.335201:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 55 00000100:00100000:2.0:1788587830.335214:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+11:2344:x1875470026070656:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587830.335233:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587830.335264:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca8b2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12dd expref: 11 pid: 6695 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.335300:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca8b2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12dd expref: 11 pid: 6695 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.335329:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca8b2a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12dd expref: 11 pid: 6695 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.335351:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587830.335356:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587830.335367:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e7bc4fd/0xa13e120d54ca8b31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12e4 expref: 10 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.335393:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e7bc4fd/0xa13e120d54ca8b31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12e4 expref: 10 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.335666:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005e7bc4fd/0xa13e120d54ca8b31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12e4 expref: 10 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587830.335686:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4a65c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1875470043905152:192.168.206.33@tcp:105: 00000100:00100000:2.0:1788587830.335818:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48341c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587830.346586:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587830.346598:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4a65c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1875470043905152:192.168.206.33@tcp:105: 00010000:00010000:2.0:1788587830.346653:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587830.346746:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:2344:x1875470026070656:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 11533us (11804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587830.346760:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 55 00000100:00100000:1.0:1788587830.347255:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026070784 00000100:00100000:1.0:1788587830.347265:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026070784 00002000:00100000:1.0:1788587830.347319:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff88f4af3e0000 x1875470026070784/t0(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:391/0 lens 504/0 e 0 to 0 dl 1788587841 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587830.347331:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4af3e0000 with x1875470026070784 ext(0->12) 00002000:00010000:1.0:1788587830.347337:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f4af3e0000 00000100:00100000:1.0:1788587830.347361:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 2 00000100:00100000:1.0:1788587830.347372:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:2345:x1875470026070784:12345-192.168.206.33@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788587830.347812:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+12:2345:x1875470026070784:12345-192.168.206.33@tcp:4:lhsmtool_posix.0 Request processed in 439us (1233us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788587830.347820:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 2 00002000:00100000:1.0:1788587830.347827:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff88f4af3e0000 x1875470026070784/t4294967308(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:391/0 lens 504/448 e 0 to 0 dl 1788587841 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587830.347836:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4af3e0000 with x1875470026070784 ext(0->12) 00002000:00010000:1.0:1788587830.347839:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f4af3e0000 00000100:00100000:1.0:1788587830.351686:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587830.352167:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026070912 00000100:00100000:3.0:1788587830.352178:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026070912 00000100:00100000:3.0:1788587830.352232:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 124 00000100:00100000:3.0:1788587830.352242:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+61:10516:x1875470026070912:12345-192.168.206.33@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788587830.388868:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00000004:00080000:3.0:1788587830.388891:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788587830.388912:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88f4b4ecaf00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788587830.388929:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f4894b3600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88f4bf6789c0 00000020:00080000:3.0:1788587830.388932:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f4894b3700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88f4c1598c00 00000020:00080000:3.0:1788587830.388967:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1788587830.388974:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000004:00080000:3.0:1788587830.388985:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:3.0:1788587830.388998:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000020:00080000:3.0:1788587830.389012:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88f4b4ecae40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788587830.389015:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f487ed7800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88f49912f900 00000020:00080000:3.0:1788587830.389018:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f487ed7c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88f4bafe3000 00000001:00080000:3.0:1788587830.389027:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788587830.389032:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788587830.389169:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788587830.389331:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788587830.389400:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043905408:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788587830.389462:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587830.389915:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:10516:x1875470026070912:12345-192.168.206.33@tcp:44:lhsmtool_posix.0 Request processed in 37670us (38235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587830.389926:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 124 00000100:00100000:3.0:1788587830.391390:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587830.391407:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043905280:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788587830.391466:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587830.391522:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043905408 00000100:00100000:3.0:1788587830.391530:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043905408 00000100:00100000:3.0:1788587830.391575:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043905280 00000100:00100000:3.0:1788587830.391578:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043905280 00000100:00100000:3.0:1788587830.391598:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788587830.391606:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb25b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1875470043905408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788587830.391647:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1788587830.391669:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8b38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.391702:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca88fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1243 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.391710:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788587830.391715:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587830.391721:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8b38 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.391752:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca88fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1243 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.391766:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca88fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1243 expref: 11 pid: 6693 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587830.391778:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb258000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1875470043905536:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587830.391827:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf713240 going to sleep for 11 seconds 00000100:00100000:0.0:1788587830.392213:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788587830.392223:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3303:x1875470043905280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788587830.392237:0:9214:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1788587830.392274:0:9214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9baf33, atime: 0x6a9baf33, ctime: 0x6a9baf33, blocks: 0x1 00010000:00010000:0.0:1788587830.392281:0:9214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca8b3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.392291:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=277s v=(0 0) 00010000:00010000:0.0:1788587830.392295:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587830.392302:0:9214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca8b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.392317:0:9214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca8b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.392326:0:9214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca8b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.392334:0:9214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca8b3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.392359:0:9214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788587830.392883:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3303:x1875470043905280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 661us (1414us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788587830.392891:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1788587830.392973:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587830.392980:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca8b3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.392990:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b600 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587830.393000:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca8b3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.393011:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca8b3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.393029:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca8b3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.393038:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000835a6a74/0xa13e120d54ca8b3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.393057:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587830.393059:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587830.393061:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788587830.393529:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88f4baa92300/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788587830.393537:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043905280:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788587830.400161:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb258000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1875470043905536:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587830.400195:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8b38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587830.401032:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587830.401139:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026071040 00000100:00100000:0.0:1788587830.401146:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026071040 00000100:00100000:0.0:1788587830.401246:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 42 00000100:00100000:0.0:1788587830.401260:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+12:2346:x1875470026071040:12345-192.168.206.33@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788587830.404983:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587830.406336:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026071168 00000100:00100000:0.0:1788587830.406347:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026071168 00010000:00010000:0.0:1788587830.406390:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca88fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1243 expref: 13 pid: 6693 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587830.406431:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 56 00000100:00100000:0.0:1788587830.406441:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:2345:x1875470026071168:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587830.406455:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587830.406462:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca88fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1243 expref: 13 pid: 6693 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.406476:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca88fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1243 expref: 13 pid: 6693 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.406499:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca88fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1243 expref: 13 pid: 6693 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.406518:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587830.406524:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587830.406531:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8b38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.406540:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8b38 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.406619:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587830.406661:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8b38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.406681:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8b38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587830.406698:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+12:2345:x1875470026071168:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 256us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587830.406706:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 56 00010000:00010000:2.0:1788587830.406711:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8b38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.406723:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8b38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.406759:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587830.407763:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587830.407774:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8b38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.407785:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031a00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:0.0:1788587830.407791:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8b38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587830.407794:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb25b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1875470043905408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16182us (18326us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788587830.407818:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788587830.407820:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8b38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.407840:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8b38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.407871:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8b38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.407904:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587830.407906:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587830.407908:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788587830.407945:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88f4baa91880/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788587830.407968:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043905408:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1788587830.486679:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788587830.486737:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1788587830.486753:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1788587830.487017:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026071040:12345-192.168.206.33@tcp:16:lhsmtool_posix.0 Request processed in 85750us (85979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587830.487030:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 42 00000100:00100000:2.0:1788587830.490823:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587830.491008:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026071424 00000100:00100000:1.0:1788587830.491021:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026071424 00000100:00100000:1.0:1788587830.491095:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 125 00000100:00100000:1.0:1788587830.491178:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:10516:x1875470026071424:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788587830.491254:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587830.491288:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8b23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12d6 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.491313:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88f488834100) 00010000:00010000:1.0:1788587830.491319:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587830.491358:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8b46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.491559:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8b46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.491571:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8b46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587830.492330:0:8471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fd9f5f0 reply state 00000000452f03ac transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8b46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587830.492345:0:8471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587830.492511:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:10516:x1875470026071424:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 1403us (1700us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788587830.492521:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 125 00000100:00100000:0.0:1788587830.496214:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00010000:00010000:1.0:1788587830.496426:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8b46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.496441:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8b46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.496451:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8b46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.496458:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587830.496464:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8b46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.496473:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8b46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.496495:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88f488834100) 00010000:00010000:1.0:1788587830.496512:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587830.496520:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8b46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.496527:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8b46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587830.496668:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026071552 00000100:00100000:3.0:1788587830.496680:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026071552 00000100:00100000:3.0:1788587830.496747:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 43 00000100:00100000:3.0:1788587830.496758:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ea2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2345:x1875470026071552:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788587830.497060:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788587830.497064:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788587828 00002000:00010000:3.0:1788587830.497066:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788587827 00002000:00010000:3.0:1788587830.497069:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788587829 -> 1788587828 00002000:00010000:3.0:1788587830.497071:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788587830.497164:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ea2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2345:x1875470026071552:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 Request processed in 407us (962us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788587830.497178:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 43 00000100:00100000:0.0:1788587830.500452:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587830.500560:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026071808 00000100:00100000:1.0:1788587830.500573:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026071808 00000100:00100000:1.0:1788587830.500653:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 126 00000100:00100000:1.0:1788587830.500665:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:10516:x1875470026071808:12345-192.168.206.33@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788587830.500758:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.500780:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8b07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12c8 expref: 15 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.500791:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.500837:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12c8 expref: 15 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.500888:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8b07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12c8 expref: 15 pid: 7276 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587830.500904:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf724380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043905664:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587830.501028:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4866476c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587830.508348:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587830.508512:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf724380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043905664:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587830.508556:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587830.508772:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026071936 00000100:00100000:0.0:1788587830.508781:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026071936 00010000:00010000:0.0:1788587830.508822:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8b07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12c8 expref: 16 pid: 7276 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587830.508907:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 57 00000100:00100000:0.0:1788587830.508918:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:2345:x1875470026071936:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587830.508938:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587830.508946:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8b07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12c8 expref: 16 pid: 7276 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.508960:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12c8 expref: 16 pid: 7276 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.508988:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8b07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12c8 expref: 16 pid: 7276 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.509009:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88f488834100) 00010000:00010000:0.0:1788587830.509014:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.509024:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.509032:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.509056:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587830.509125:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:2345:x1875470026071936:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 208us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587830.509142:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 57 00010000:00010000:1.0:1788587830.509256:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.509264:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.509302:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.509310:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.509317:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.509324:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587830.509329:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.509338:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.509348:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88f488834100) 00010000:00010000:1.0:1788587830.509351:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788587830.509355:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.509361:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8b4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587830.509405:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:10516:x1875470026071808:12345-192.168.206.33@tcp:55:lhsmtool_posix.0 Request processed in 8743us (8968us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788587830.509426:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 126 00000100:00100000:0.0:1788587830.511877:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587830.512095:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026072064 00000100:00100000:2.0:1788587830.512107:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026072064 00000100:00100000:2.0:1788587830.512181:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 44 00000100:00100000:2.0:1788587830.512193:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2345:x1875470026072064:12345-192.168.206.33@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788587830.512251:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ce300852/0xa13e120d54ca8b54 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.512276:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e7bc4fd/0xa13e120d54ca8b31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12e4 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.512287:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587830.512292:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587830.512297:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce300852/0xa13e120d54ca8b54 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.512744:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e7bc4fd/0xa13e120d54ca8b31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12e4 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.512765:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e7bc4fd/0xa13e120d54ca8b31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12e4 expref: 7 pid: 6694 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587830.512783:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4a65880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1875470043905792:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587830.513150:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486769d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587830.516194:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4a65880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1875470043905792:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587830.516296:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce300852/0xa13e120d54ca8b54 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587830.518634:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587830.518732:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026072192 00000100:00100000:2.0:1788587830.518744:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026072192 00010000:00010000:2.0:1788587830.518796:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e7bc4fd/0xa13e120d54ca8b31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12e4 expref: 8 pid: 6694 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587830.518926:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 58 00000100:00100000:2.0:1788587830.518939:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026072192:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587830.518958:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587830.518990:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e7bc4fd/0xa13e120d54ca8b31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12e4 expref: 8 pid: 6694 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.519005:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e7bc4fd/0xa13e120d54ca8b31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12e4 expref: 8 pid: 6694 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.519032:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e7bc4fd/0xa13e120d54ca8b31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12e4 expref: 8 pid: 6694 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.519050:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587830.519054:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587830.519061:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce300852/0xa13e120d54ca8b54 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.519072:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce300852/0xa13e120d54ca8b54 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.519151:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587830.519225:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2344:x1875470026072192:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 288us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587830.519233:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 58 00010000:00010000:3.0:1788587830.519471:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce300852/0xa13e120d54ca8b54 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.519483:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce300852/0xa13e120d54ca8b54 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.519513:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ce300852/0xa13e120d54ca8b54 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.519522:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce300852/0xa13e120d54ca8b54 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.519531:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce300852/0xa13e120d54ca8b54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.519547:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159dc00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:3.0:1788587830.519552:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce300852/0xa13e120d54ca8b54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.519563:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce300852/0xa13e120d54ca8b54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.519577:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce300852/0xa13e120d54ca8b54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.519586:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce300852/0xa13e120d54ca8b54 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587830.519654:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2345:x1875470026072064:12345-192.168.206.33@tcp:1:lhsmtool_posix.0 Request processed in 7463us (7998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587830.519663:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 44 00000100:00100000:0.0:1788587830.527651:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587830.527745:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026072448 00000100:00100000:3.0:1788587830.527757:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026072448 00000100:00100000:3.0:1788587830.527923:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 127 00000100:00100000:3.0:1788587830.527935:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:10516:x1875470026072448:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788587830.528043:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8b5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.528066:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8b5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587830.528168:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8b5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.530486:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.530768:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca8b15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12cf expref: 15 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.530945:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.531004:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca8b15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12cf expref: 15 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.531024:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca8b15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12cf expref: 15 pid: 8471 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587830.531044:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4a65880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875470043905920:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587830.531178:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486769d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587830.534489:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4a65880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875470043905920:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587830.534530:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587830.535230:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587830.535313:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026072576 00000100:00100000:1.0:1788587830.535323:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026072576 00010000:00010000:1.0:1788587830.535370:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca8b15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12cf expref: 16 pid: 8471 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587830.535471:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 59 00000100:00100000:1.0:1788587830.535482:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:2345:x1875470026072576:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587830.535500:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587830.535508:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca8b15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12cf expref: 16 pid: 8471 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.535526:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca8b15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12cf expref: 16 pid: 8471 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.535554:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca8b15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12cf expref: 16 pid: 8471 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.535571:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88f488834100) 00010000:00010000:1.0:1788587830.535576:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.535586:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.535593:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.535660:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587830.535688:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.535709:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587830.535778:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:2345:x1875470026072576:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 296us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587830.535787:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 59 00000001:00080000:2.0:1788587830.536235:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788587830.537983:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788587830.538056:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788587830.538181:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4a65880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875470043906048:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788587830.538261:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587830.538312:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587830.538561:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043906048 00000100:00100000:3.0:1788587830.538570:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043906048 00000100:00100000:3.0:1788587830.538652:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587830.538663:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875470043906048:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788587830.538758:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875470043906048:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587830.538766:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587830.539081:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788587830.539089:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1788587830.539184:0:5841:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88f4baa91880 x1875470043905408/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788587846 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587830.539200:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4a65880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875470043906048:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788587830.540202:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788587830.540303:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4a65880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875470043906176:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788587830.540366:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587830.540438:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf713c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587830.540478:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043906176 00000100:00100000:1.0:1788587830.540487:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043906176 00000100:00100000:1.0:1788587830.541542:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587830.541561:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875470043906176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788587830.542166:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5841:x1875470043906176:12345-0@lo:1000:mdt00_000.0 Request processed in 609us (1796us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788587830.542177:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587830.542216:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4a65880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875470043906176:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788587830.542270:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542281:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542289:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542316:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159da00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587830.542322:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542332:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542353:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88f488834100) 00010000:00010000:2.0:1788587830.542357:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587830.542362:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542368:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8b62 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542406:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8aa5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542413:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8aa5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542419:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8aa5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542424:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587830.542427:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8aa5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542432:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8aa5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542451:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:2.0:1788587830.542454:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587830.542462:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca8aac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12b3 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542474:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca8aac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12b3 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542484:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca8aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12b3 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.542537:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca8aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12b3 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587830.542552:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4a64000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875470043906304:192.168.206.33@tcp:105: 00000100:00100000:2.0:1788587830.542655:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf713c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587830.545677:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587830.545776:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026072704 00000100:00100000:3.0:1788587830.545787:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026072704 00000100:00100000:3.0:1788587830.545883:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 31 00000100:00100000:3.0:1788587830.545894:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:10515:x1875470026072704:12345-192.168.206.33@tcp:49:lfs.0 00000100:00100000:3.0:1788587830.546073:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:10515:x1875470026072704:12345-192.168.206.33@tcp:49:lfs.0 Request processed in 181us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587830.546081:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 31 00000100:00100000:2.0:1788587830.546472:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4a64000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875470043906304:192.168.206.33@tcp:105: 00010000:00010000:2.0:1788587830.546506:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8aa5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546519:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8aa5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546560:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546577:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546678:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546689:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546696:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b69 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546704:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546710:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159dc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587830.546714:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546721:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b69 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546736:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:2.0:1788587830.546739:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587830.546743:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b69 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546754:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8b69 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546766:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8b5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546771:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8b5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546783:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8b5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546789:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587830.546792:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8b5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546798:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8b5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.546988:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:2.0:1788587830.546991:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587830.546996:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8b5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.547002:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8b5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587830.547495:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+18:10516:x1875470026072448:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 19558us (19854us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788587830.547506:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 127 00000020:00080000:2.0:1788587830.547512:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788587830.547698:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587830.547704:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587830.548436:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788587830.548450:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788587830.550222:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587830.550338:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587830.550365:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026072960 00000100:00100000:1.0:1788587830.550378:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026072960 00000100:00100000:1.0:1788587830.550444:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 128 00000100:00100000:1.0:1788587830.550458:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+18:10515:x1875470026072960:12345-192.168.206.33@tcp:58:lfs.0 00000100:00100000:2.0:1788587830.550873:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026073216 00000100:00100000:2.0:1788587830.550880:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026073216 00000100:00100000:0.0:1788587830.550942:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 32 00000100:00100000:0.0:1788587830.550955:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f483777850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:10516:x1875470026073216:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1788587830.551065:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000004:00080000:0.0:1788587830.551645:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788587830.551770:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788587830.551823:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8b70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.551874:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8b70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.551890:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8b70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.551900:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8b70 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.551908:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8b70 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.551916:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8b70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587830.551926:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:10515:x1875470026072960:12345-192.168.206.33@tcp:58:lfs.0 Request processed in 1467us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587830.551941:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 128 00010000:00010000:0.0:1788587830.551967:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788587830.552034:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f483777850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:10516:x1875470026073216:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 Request processed in 1082us (1696us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788587830.552043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 32 00000020:00080000:0.0:1788587830.552047:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788587830.552049:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587830.552058:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8b70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.552065:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77ae00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587830.552070:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8b70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.552086:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8b70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.552112:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88f489033200) 00010000:00010000:2.0:1788587830.552116:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788587830.552122:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8b70 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.552129:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8b70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587830.552151:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587830.552154:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587830.552155:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587830.574937:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587830.575092:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026073344 00000100:00100000:1.0:1788587830.575105:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026073344 00000100:00100000:1.0:1788587830.575207:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 129 00000100:00100000:1.0:1788587830.575240:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:10518:x1875470026073344:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587830.575270:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587830.575297:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8b77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db12eb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.575395:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8b7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.575413:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8b7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.575434:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8b7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.575452:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.575460:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.575468:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.575769:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8b8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.575783:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12ac expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.575792:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8b8c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.575871:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12ac expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.575888:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12ac expref: 21 pid: 5842 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587830.575902:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf727b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043906432:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587830.576014:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486647f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587830.578881:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587830.578964:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026073600 00000100:00100000:2.0:1788587830.578973:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026073600 00000100:00100000:1.0:1788587830.578990:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf727b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043906432:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587830.579023:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8b8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587830.579033:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 33 00000100:00100000:2.0:1788587830.579043:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:5584:x1875470026073600:12345-192.168.206.33@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788587830.579371:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+23:5584:x1875470026073600:12345-192.168.206.33@tcp:35:ldlm_bl.0 Request processed in 327us (502us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788587830.579380:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 33 00000100:00100000:3.0:1788587830.581209:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587830.581475:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026073728 00000100:00100000:0.0:1788587830.581486:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026073728 00010000:00010000:0.0:1788587830.581530:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12ac expref: 23 pid: 5842 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587830.582136:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 60 00000100:00100000:0.0:1788587830.582152:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+23:2344:x1875470026073728:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587830.582171:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587830.582180:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12ac expref: 23 pid: 5842 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.582197:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12ac expref: 23 pid: 5842 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.582701:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8a97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12ac expref: 23 pid: 5842 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.582726:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:0.0:1788587830.582732:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8b8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.582744:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.582771:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8b8c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587830.583060:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587830.583145:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:2344:x1875470026073728:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 996us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587830.583154:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 60 00010000:00010000:1.0:1788587830.583690:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.583701:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587830.583758:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788587830.583763:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587830.583786:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.583802:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.584102:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8b7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.584131:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8b7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.584138:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8b7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.584144:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587830.584149:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8b7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.584159:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8b7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.584174:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:1.0:1788587830.584177:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587830.584182:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8b7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.584189:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8b7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.585199:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.585504:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.585511:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.585517:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587830.585537:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.585547:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.585669:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88f48fa37300) 00010000:00010000:1.0:1788587830.585673:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587830.585680:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.585688:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.585753:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8b77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12eb expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.585770:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8b8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12eb expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587830.585779:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:1.0:1788587830.585782:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587830.585785:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1a00, rc 0) 00000100:00100000:1.0:1788587830.586139:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:10518:x1875470026073344:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 10900us (11214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587830.586149:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 129 00010000:00010000:0.0:1788587830.728153:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587830.754268:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587830.754364:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587830.754394:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587830.754432:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026073984 00000100:00100000:3.0:1788587830.754445:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026073984 00000100:00100000:3.0:1788587830.754530:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 58 00000100:00100000:3.0:1788587830.754542:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2345:x1875470026073984:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587830.754660:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2345:x1875470026073984:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 119us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587830.754668:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 58 00000100:00080000:3.0:1788587830.754697:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587830.754893:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026074112 00000100:00100000:2.0:1788587830.754899:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026074112 00000100:00100000:2.0:1788587830.754945:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 121 00000100:00100000:2.0:1788587830.754953:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026074112:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587830.754989:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026074112:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 37us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587830.755024:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 121 00000100:00080000:3.0:1788587830.755043:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587830.755720:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026073856 00000100:00100000:0.0:1788587830.755729:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026073856 00000100:00100000:0.0:1788587830.756298:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 281 00000100:00100000:0.0:1788587830.756309:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026073856:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587830.756386:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026073856:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 79us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587830.756393:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 281 00000001:00080000:0.0:1788587831.316492:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1788587831.316525:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:0.0:1788587831.316535:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:3.0:1788587831.378683:0:12060:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587831.378694:0:12060:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587831.378763:0:12060:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788587831.378771:0:12060:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788587831.560093:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587831.560177:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587831.560220:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788587831.560226:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587831.560361:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf727b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875470043906560:192.168.206.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788587831.560590:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486647d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587831.573053:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587831.573301:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf727b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875470043906560:192.168.206.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788587831.576156:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026074240 00000100:00100000:3.0:1788587831.576169:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026074240 00000100:00080000:0.0:1788587831.576232:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587831.576250:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 130 00000100:00100000:3.0:1788587831.576260:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:10530:x1875470026074240:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788587831.576295:0:8471:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788587831.576406:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:10530:x1875470026074240:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 Request processed in 148us (3363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587831.576413:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 130 00000100:00100000:2.0:1788587831.581877:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587831.582306:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026074496 00000100:00100000:1.0:1788587831.582317:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026074496 00000100:00100000:1.0:1788587831.582377:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 131 00000100:00100000:1.0:1788587831.582387:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:10530:x1875470026074496:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587831.582408:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587831.582438:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8b93 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db12f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587831.582538:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587831.582553:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587831.582568:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587831.582580:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788587831.582723:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8b93 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12f2 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587831.582741:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12f2 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587831.582750:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:1.0:1788587831.582768:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587831.582772:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1c00, rc 0) 00000100:00100000:1.0:1788587831.583394:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+23:10530:x1875470026074496:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 452us (1002us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788587831.583406:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 131 00000100:00100000:2.0:1788587831.587653:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587831.587754:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026074752 00000100:00100000:0.0:1788587831.587764:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026074752 00000100:00100000:0.0:1788587831.587815:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 132 00000100:00100000:0.0:1788587831.587823:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+23:10530:x1875470026074752:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788587831.587936:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8ba8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587831.587953:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587831.587980:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587831.588139:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587831.588147:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8ba8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587831.588154:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8ba8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587831.588159:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587831.588163:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8ba8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587831.588170:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8ba8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587831.588182:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:0.0:1788587831.588185:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587831.588189:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8ba8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587831.588195:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8ba8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587831.588323:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:10530:x1875470026074752:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 499us (677us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788587831.588331:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 132 00000040:00080000:1.0:1788587831.588553:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587831.588557:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587831.589114:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788587831.589123:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788587831.596114:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587831.596162:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587831.596427:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026075136 00000100:00100000:3.0:1788587831.596445:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026075136 00000100:00100000:3.0:1788587831.596518:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 34 00000100:00100000:3.0:1788587831.596531:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:10530:x1875470026075136:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788587831.596728:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026074880 00000100:00100000:2.0:1788587831.596733:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026074880 00000100:00100000:3.0:1788587831.597165:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:10530:x1875470026075136:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 Request processed in 634us (999us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788587831.597175:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 34 00000100:00100000:2.0:1788587831.597280:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00100000:2.0:1788587831.597291:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+25:2347:x1875470026074880:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587831.597305:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587831.597337:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8b9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12f2 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587831.597356:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:2.0:1788587831.597363:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587831.597384:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:2347:x1875470026074880:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 97us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587831.597390:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 9 00010000:00010000:2.0:1788587831.752042:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587832.776618:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587833.260937:0:12111:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587833.260950:0:12111:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587833.261007:0:12111:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788587833.261014:0:12111:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788587833.417721:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587833.419662:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026075392 00000100:00100000:3.0:1788587833.419681:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026075392 00000100:00100000:3.0:1788587833.419780:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 133 00000100:00100000:3.0:1788587833.419792:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:10551:x1875470026075392:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587833.419820:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587833.419864:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8baf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db12f9 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587833.420015:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8bb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587833.420034:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587833.420048:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587833.420060:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788587833.422764:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8baf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12f9 expref: 27 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587833.422795:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12f9 expref: 26 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587833.422807:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:3.0:1788587833.422812:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788587833.422816:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030400, rc 0) 00000100:00100000:3.0:1788587833.422930:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:10551:x1875470026075392:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 3139us (5222us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788587833.422939:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 133 00000100:00080000:3.0:1788587833.422994:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587833.428292:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587833.428336:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026075520 00000100:00100000:2.0:1788587833.430678:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026075520 00000100:00100000:2.0:1788587833.430783:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 134 00000100:00100000:2.0:1788587833.430795:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:10551:x1875470026075520:12345-192.168.206.33@tcp:54:lfs.0 00010000:00010000:2.0:1788587833.430904:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8bc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587833.430944:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587833.430960:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587833.430996:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587833.431005:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8bc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587833.431013:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587833.431021:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587833.431026:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587833.431036:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8bc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587833.431050:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:2.0:1788587833.431054:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587833.431060:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8bc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587833.431067:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8bc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587833.431165:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:10551:x1875470026075520:12345-192.168.206.33@tcp:54:lfs.0 Request processed in 372us (2889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587833.431181:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 134 00000100:00100000:3.0:1788587833.553204:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587833.553377:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026075648 00000100:00100000:0.0:1788587833.553390:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026075648 00000100:00100000:0.0:1788587833.553488:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 45 00000100:00100000:0.0:1788587833.553501:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026075648:12345-192.168.206.33@tcp:101:cat.0 00010000:00010000:0.0:1788587833.553526:0:9214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587833.553552:0:9214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000455e124c/0xa13e120d54ca8bcb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1300 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587833.553585:0:9214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9baf34, atime: 0x6a9baf33, ctime: 0x6a9baf34, blocks: 0xb 00010000:00010000:0.0:1788587833.553633:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1788587833.553639:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587833.553652:0:9214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000455e124c/0xa13e120d54ca8bcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1300 expref: 7 pid: 9214 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587833.553676:0:9214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000455e124c/0xa13e120d54ca8bcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1300 expref: 7 pid: 9214 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587833.553693:0:9214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a600, rc 0) 00000100:00100000:0.0:1788587833.553773:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2346:x1875470026075648:12345-192.168.206.33@tcp:101:cat.0 Request processed in 274us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587833.554245:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 45 00000100:00080000:3.0:1788587833.554413:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587833.562018:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587833.562206:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026075776 00000100:00100000:3.0:1788587833.562218:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026075776 00002000:00100000:3.0:1788587833.562283:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff88f4b4a66d80 x1875470026075776/t0(0) o3->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:394/0 lens 488/0 e 0 to 0 dl 1788587844 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587833.562295:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4b4a66d80 with x1875470026075776 ext(0->4095) 00002000:00010000:3.0:1788587833.562302:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f4b4a66d80 00000100:00100000:3.0:1788587833.562381:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 3 00000100:00100000:3.0:1788587833.562391:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2347:x1875470026075776:12345-192.168.206.33@tcp:3:cat.0 00000100:00100000:3.0:1788587833.562713:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2347:x1875470026075776:12345-192.168.206.33@tcp:3:cat.0 Request processed in 321us (868us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788587833.562723:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 3 00002000:00100000:3.0:1788587833.562731:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff88f4b4a66d80 x1875470026075776/t0(0) o3->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:394/0 lens 488/4536 e 0 to 0 dl 1788587844 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587833.562739:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4b4a66d80 with x1875470026075776 ext(0->4095) 00002000:00010000:3.0:1788587833.562743:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f4b4a66d80 00010000:00010000:2.0:1788587833.802704:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587834.314293:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587834.314312:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043906688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587834.314373:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587834.314510:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043906688 00000100:00100000:3.0:1788587834.314518:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043906688 00000100:00100000:3.0:1788587834.314586:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788587834.314617:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587834.314764:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043906688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587834.314795:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587834.314859:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043906688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587834.314867:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788587834.314891:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788587834.314897:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:0.0:1788587834.314917:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88f4bacbca80, transno 4294967301 00000004:00080000:0.0:1788587834.314936:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788587834.314948:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88f4baa92300, transno 4294967304 00000100:00100000:0.0:1788587834.314958:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043906688:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788587834.824022:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788587835.336355:0:7954:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 282591508255ns, next at 283591504994ns, rc = 0 00000100:00100000:2.0:1788587835.336521:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043906944:0@lo:400:kworker.0 00000100:00100000:2.0:1788587835.336626:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587835.336706:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043906816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587835.336740:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587835.336763:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043907456:0@lo:400:kworker.0 00000100:00100000:2.0:1788587835.336790:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587835.336820:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587835.336826:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043907328:0@lo:400:kworker.0 00000100:00100000:2.0:1788587835.336894:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587835.336927:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043907200:0@lo:400:kworker.0 00000100:00100000:2.0:1788587835.336957:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587835.336985:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043906944 00000100:00100000:2.0:1788587835.336988:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043907456 00000100:00100000:0.0:1788587835.336994:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043906944 00000100:00100000:0.0:1788587835.337064:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788587835.337076:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043906944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587835.337142:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043906944:12345-0@lo:400:kworker.0 Request processed in 68us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587835.337150:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788587835.337210:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043906944:0@lo:400:kworker.0 00000100:00100000:0.0:1788587835.337253:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043907328 00000100:00100000:0.0:1788587835.337258:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043907328 00000100:00100000:2.0:1788587835.337549:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043907456 00000100:00100000:2.0:1788587835.337612:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043907200 00000100:00100000:2.0:1788587835.337615:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043907200 00000100:00100000:2.0:1788587835.337636:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788587835.337704:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043907456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587835.337757:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043907456:12345-0@lo:400:kworker.0 Request processed in 114us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587835.337764:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788587835.337767:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788587835.337774:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043907328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587835.337777:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788587835.337782:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043907200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587835.337810:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043907328:12345-0@lo:400:kworker.0 Request processed in 37us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587835.337816:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788587835.337831:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043907200:12345-0@lo:400:kworker.0 Request processed in 49us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587835.337836:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788587835.337837:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043906816 00000100:00100000:0.0:1788587835.337864:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043906816 00000100:00080000:2.0:1788587835.337877:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587835.337912:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043907200:0@lo:400:kworker.0 00000100:00100000:2.0:1788587835.337938:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043907328:0@lo:400:kworker.0 00000100:00100000:2.0:1788587835.337951:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043907456:0@lo:400:kworker.0 00000100:00100000:0.0:1788587835.338150:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788587835.338158:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875470043906816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587835.338195:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587835.338235:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043907072:0@lo:400:kworker.0 00000100:00100000:0.0:1788587835.338247:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875470043906816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587835.338253:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788587835.338272:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587835.338277:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587835.338306:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043907584:0@lo:400:kworker.0 00000100:00100000:3.0:1788587835.338330:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587835.338367:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043907072 00000100:00100000:3.0:1788587835.338371:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043907072 00000100:00100000:3.0:1788587835.338397:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788587835.338404:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043907072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587835.338509:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043907584 00000100:00100000:2.0:1788587835.338513:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043907584 00000100:00100000:2.0:1788587835.338539:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788587835.338546:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1875470043907584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587835.338595:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1875470043907584:12345-0@lo:400:kworker.0 Request processed in 37us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587835.338601:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788587835.338644:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043907584:0@lo:400:kworker.0 00000100:00100000:3.0:1788587835.338749:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043907072:12345-0@lo:400:kworker.0 Request processed in 345us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587835.338756:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788587835.338921:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043906816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587835.339391:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043907072:0@lo:400:kworker.0 00010000:00010000:2.0:1788587835.849125:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587835.870920:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587835.870960:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587835.872232:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026075904 00000100:00100000:0.0:1788587835.872252:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026075904 00000100:00100000:0.0:1788587835.872333:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 283 00000100:00100000:0.0:1788587835.872347:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2346:x1875470026075904:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587835.872445:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2346:x1875470026075904:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 101us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587835.872454:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 283 00000100:00100000:0.0:1788587835.872497:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026076160 00000100:00100000:0.0:1788587835.872501:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026076160 00000100:00100000:0.0:1788587835.872542:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 61 00000100:00100000:0.0:1788587835.872548:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2346:x1875470026076160:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587835.872575:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2346:x1875470026076160:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 28us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587835.872593:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 61 00000100:00080000:0.0:1788587835.872953:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587835.884749:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587835.885147:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587835.891061:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587835.891637:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026076416 00000100:00100000:0.0:1788587835.891650:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026076416 00000100:00100000:2.0:1788587835.893209:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026076288 00000100:00100000:2.0:1788587835.893224:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026076288 00000100:00100000:2.0:1788587835.893309:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 62 00000100:00100000:2.0:1788587835.893320:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2346:x1875470026076288:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587835.893507:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2346:x1875470026076288:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 187us (2458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587835.893619:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026076032 00000100:00100000:1.0:1788587835.893625:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026076032 00000100:00100000:1.0:1788587835.894303:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 125 00000100:00100000:1.0:1788587835.894316:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:2346:x1875470026076032:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587835.894377:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:2346:x1875470026076032:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 64us (9232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587835.894386:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 125 00000100:00100000:2.0:1788587835.898341:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 62 00000100:00080000:2.0:1788587835.898458:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587835.898482:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587835.898945:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587835.899242:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 126 00000100:00100000:1.0:1788587835.899259:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026076416:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587835.899452:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026076416:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 198us (14716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587835.899471:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 126 00000001:00080000:1.0:1788587835.916312:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:1.0:1788587835.918764:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88f4bf7133c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788587835.918785:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f4bab0bf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88f4bf713600 00000020:00080000:1.0:1788587835.918789:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f4bab0be00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88f4b53a1c00 00000004:00080000:1.0:1788587835.918819:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:1.0:1788587835.918869:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1788587835.919146:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:1.0:1788587835.919249:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587835.919275:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043907712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788587835.919377:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587835.919595:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043907712 00000100:00100000:1.0:1788587835.919604:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043907712 00000100:00100000:1.0:1788587835.919662:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587835.919672:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1875470043907712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788587835.920176:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788587835.920181:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788587828 -> 1788587828 00002000:00010000:1.0:1788587835.920184:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1788587827 -> 1788587827 00002000:00010000:1.0:1788587835.920186:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788587828 -> 1788587828 00002000:00010000:1.0:1788587835.920189:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788587835.920243:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3302:x1875470043907712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 571us (875us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788587835.920252:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:1.0:1788587835.920310:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88f4bf727b80/2, rc 0, transno 4294967312 00000100:00100000:1.0:1788587835.920317:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043907712:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1788587835.920540:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788587835.920765:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1788587835.955932:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1788587835.956003:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:3.0:1788587836.872562:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587837.900042:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587838.197169:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587838.197282:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026076544 00000100:00100000:2.0:1788587838.197299:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026076544 00000100:00100000:2.0:1788587838.197401:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 135 00000100:00100000:2.0:1788587838.197425:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:10204:x1875470026076544:12345-192.168.206.33@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788587838.197586:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:10204:x1875470026076544:12345-192.168.206.33@tcp:60:lhsmtool_posix.0 Request processed in 174us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587838.197595:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 135 00000100:00080000:1.0:1788587838.198250:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587838.202133:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587838.202311:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026076800 00000100:00100000:0.0:1788587838.202324:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026076800 00000100:00100000:0.0:1788587838.202395:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 35 00000100:00100000:0.0:1788587838.202416:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:10204:x1875470026076800:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788587838.202930:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:10204:x1875470026076800:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 Request processed in 521us (807us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788587838.202940:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 35 00000100:00100000:0.0:1788587838.442660:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587838.442799:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026076928 00000100:00100000:2.0:1788587838.442811:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026076928 00000100:00100000:2.0:1788587838.442941:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 136 00000100:00100000:2.0:1788587838.442953:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b66627bb-533c-4cf5-aca4-320057d76d08+5:11003:x1875470026076928:12345-192.168.206.33@tcp:101:lsof.0 00010000:00010000:2.0:1788587838.442984:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587838.443011:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8bd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1307 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587838.443100:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8bd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587838.443118:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587838.443131:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587838.443176:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587838.443180:0:8471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587838.443229:0:8471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587838.443279:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8bd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1307 expref: 7 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587838.443300:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1307 expref: 6 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587838.443310:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44900) 00010000:00010000:2.0:1788587838.443314:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587838.443318:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159da00, rc 0) 00000100:00100000:2.0:1788587838.443392:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b66627bb-533c-4cf5-aca4-320057d76d08+6:11003:x1875470026076928:12345-192.168.206.33@tcp:101:lsof.0 Request processed in 441us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587838.443400:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 136 00000100:00080000:3.0:1788587838.444644:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587838.920396:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587839.432132:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043907840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587839.432236:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587839.432641:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043907840 00000100:00100000:0.0:1788587839.432654:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043907840 00000100:00100000:0.0:1788587839.432742:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788587839.432755:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043907840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587839.432801:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587839.432896:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043907840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587839.432904:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788587839.432976:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587839.437469:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043907840:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788587839.944078:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587840.456575:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043907968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587840.456673:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587840.459217:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043907968 00000100:00100000:0.0:1788587840.459237:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043907968 00000100:00100000:0.0:1788587840.459339:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788587840.459367:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875470043907968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587840.459415:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587840.459519:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875470043907968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (2846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587840.459527:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788587840.459784:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587840.461543:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043908480:0@lo:400:kworker.0 00000100:00100000:2.0:1788587840.461642:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587840.461720:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788587840.461726:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88f4baa91880, transno 4294967309 00000004:00080000:2.0:1788587840.461737:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:2.0:1788587840.461767:0:3305:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88f4bf727b80 x1875470043907712/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788587851 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587840.461790:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043907968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587840.461838:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587840.461904:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043908352:0@lo:400:kworker.0 00000100:00100000:2.0:1788587840.461935:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587840.461969:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043908480 00000100:00100000:2.0:1788587840.461976:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043908480 00000100:00100000:2.0:1788587840.462043:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788587840.462060:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043908480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587840.462108:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043908480:12345-0@lo:400:kworker.0 Request processed in 56us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587840.462203:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788587840.462332:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043908480:0@lo:400:kworker.0 00000100:00100000:1.0:1788587840.462664:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043908096:0@lo:400:kworker.0 00000100:00100000:1.0:1788587840.462717:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587840.462758:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f485d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043908608:0@lo:400:kworker.0 00000100:00100000:1.0:1788587840.462785:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587840.462823:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587840.462829:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f487a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043908224:0@lo:400:kworker.0 00000100:00100000:1.0:1788587840.462883:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587840.463445:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043908352 00000100:00100000:1.0:1788587840.463453:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043908352 00000100:00100000:1.0:1788587840.463501:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043908608 00000100:00100000:1.0:1788587840.463504:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043908608 00000100:00100000:1.0:1788587840.463522:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043908224 00000100:00100000:1.0:1788587840.463525:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043908224 00000100:00100000:1.0:1788587840.463541:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788587840.463549:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043908352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587840.463623:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043908352:12345-0@lo:400:kworker.0 Request processed in 74us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587840.463629:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788587840.463647:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788587840.463653:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043908608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587840.463682:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043908608:12345-0@lo:400:kworker.0 Request processed in 30us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587840.463697:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788587840.463708:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788587840.463713:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043908224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587840.463739:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043908224:12345-0@lo:400:kworker.0 Request processed in 27us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587840.463745:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1788587840.463764:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587840.463796:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043908224:0@lo:400:kworker.0 00000100:00100000:1.0:1788587840.463807:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f485d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043908608:0@lo:400:kworker.0 00000100:00100000:3.0:1788587840.464005:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043908096 00000100:00100000:3.0:1788587840.464010:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043908096 00000100:00100000:3.0:1788587840.464075:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788587840.464082:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043908096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587840.464135:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043908096:12345-0@lo:400:kworker.0 Request processed in 54us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587840.464141:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788587840.464182:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043908096:0@lo:400:kworker.0 00000100:00100000:2.0:1788587840.464723:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f487a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043908352:0@lo:400:kworker.0 00010000:00010000:1.0:1788587840.968136:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587840.998944:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587840.998998:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587840.999021:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587840.999057:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587840.999090:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587840.999264:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026077184 00000100:00100000:3.0:1788587840.999278:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026077184 00000100:00080000:2.0:1788587840.999335:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587840.999375:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026077568 00000100:00100000:3.0:1788587840.999379:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026077568 00000100:00100000:2.0:1788587840.999403:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 130 00000100:00100000:2.0:1788587840.999416:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:2346:x1875470026077184:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587840.999456:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026077056 00000100:00100000:0.0:1788587840.999460:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026077056 00000100:00100000:0.0:1788587840.999492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 285 00000100:00100000:0.0:1788587840.999498:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2347:x1875470026077056:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587840.999524:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:2346:x1875470026077184:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 112us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587840.999524:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2347:x1875470026077056:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 26us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587841.002109:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 285 00000100:00100000:0.0:1788587841.003162:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026077312 00000100:00100000:0.0:1788587841.003178:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026077312 00000100:00100000:0.0:1788587841.003274:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026077440 00000100:00100000:0.0:1788587841.003278:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026077440 00000100:00100000:0.0:1788587841.003310:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 64 00000100:00100000:0.0:1788587841.003322:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2347:x1875470026077312:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587841.003521:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2347:x1875470026077312:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 201us (4498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587841.003529:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 64 00000100:00100000:0.0:1788587841.003547:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 65 00000100:00100000:0.0:1788587841.003569:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026077440:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587841.003599:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2346:x1875470026077440:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 45us (4508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587841.003605:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 65 00000100:00100000:3.0:1788587841.006588:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 131 00000100:00100000:3.0:1788587841.006613:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+6:2347:x1875470026077568:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587841.006714:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b66627bb-533c-4cf5-aca4-320057d76d08+6:2347:x1875470026077568:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 111us (7665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587841.006723:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 131 00000100:00100000:2.0:1788587841.007778:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 130 00000100:00080000:2.0:1788587841.008188:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587841.008195:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587841.008207:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788587841.031432:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1788587841.036750:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788587841.036770:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788587841.036876:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788587841.036890:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:0.0:1788587841.482509:0:12313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:57:19 (1788587839) 00000040:00080000:1.0:1788587841.864171:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587841.864184:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587841.867079:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:1.0:1788587841.867096:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788587841.992715:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587842.852282:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587842.852528:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026077824 00000100:00100000:0.0:1788587842.852540:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026077824 00000100:00100000:0.0:1788587842.852634:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 137 00000100:00100000:0.0:1788587842.852647:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:11267:x1875470026077824:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587842.852673:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587842.852699:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8be0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db130e expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.852814:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8be7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.852833:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8be7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.852885:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8be7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.852905:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8bee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.852912:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8bee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.852919:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8bee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788587842.853187:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788587842.854240:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8bf5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.854262:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.854274:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587842.854289:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788587842.855783:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8be7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.855800:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8be7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.855825:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8be7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.855831:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77ae00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587842.855836:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8be7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.855873:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8be7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.855892:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88f489033600) 00010000:00010000:0.0:1788587842.855896:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587842.855901:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8be7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.855907:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8be7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.855925:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8bee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.855931:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8bee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.855937:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8bee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.855941:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587842.855944:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8bee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.855960:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8bee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.855969:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88f489033b00) 00010000:00010000:0.0:1788587842.855971:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587842.855974:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8bee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.855980:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8bee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.858191:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8be0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db130e expref: 16 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.858226:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db130e expref: 15 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.858237:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44800) 00010000:00010000:0.0:1788587842.858240:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587842.858245:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b400, rc 0) 00000100:00100000:0.0:1788587842.858350:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:11267:x1875470026077824:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 5704us (6081us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788587842.858361:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 137 00000100:00100000:2.0:1788587842.870508:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587842.870637:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587842.870924:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026078080 00000100:00100000:3.0:1788587842.870937:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026078080 00000100:00100000:3.0:1788587842.871025:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 138 00000100:00100000:3.0:1788587842.871037:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:11267:x1875470026078080:12345-192.168.206.33@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788587842.871162:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026077952 00000100:00100000:0.0:1788587842.871167:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026077952 00000100:00100000:3.0:1788587842.871168:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:11267:x1875470026078080:12345-192.168.206.33@tcp:59:lhsmtool_posix.0 Request processed in 133us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587842.871175:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 138 00000100:00100000:0.0:1788587842.871205:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:0.0:1788587842.871214:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:2346:x1875470026077952:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587842.871247:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587842.871279:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8bf5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db130e expref: 15 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587842.871302:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44800) 00010000:00010000:0.0:1788587842.871307:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587842.871330:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:2346:x1875470026077952:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 118us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587842.871336:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 10 00000040:00080000:2.0:1788587842.888375:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587842.888388:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587842.888430:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:2.0:1788587842.888440:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788587843.016677:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587844.041056:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587844.565766:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043908736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587844.565883:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587844.566985:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043908736 00000100:00100000:1.0:1788587844.566999:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043908736 00000100:00100000:1.0:1788587844.567075:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788587844.567088:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043908736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587844.567137:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788587844.567304:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587844.569513:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043908736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2414us (3616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587844.569530:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788587844.573464:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043908736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587844.974742:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587844.974880:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026078208 00000100:00100000:3.0:1788587844.974894:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026078208 00000100:00100000:3.0:1788587844.974992:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 139 00000100:00100000:3.0:1788587844.975004:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:11310:x1875470026078208:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587844.975043:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587844.975072:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8c03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1315 expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975151:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975167:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975184:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975200:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975207:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975214:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975478:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975488:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c0a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975495:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975512:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587844.975517:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975525:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975550:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44900) 00010000:00010000:3.0:1788587844.975554:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587844.975561:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975568:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975584:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975590:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975596:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975602:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587844.975605:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975610:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975630:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88f484d44600) 00010000:00010000:3.0:1788587844.975633:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587844.975635:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975642:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975682:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8c03 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1315 expref: 15 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975694:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44900) 00010000:00010000:3.0:1788587844.975697:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587844.975701:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8c03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1315 expref: 15 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.975711:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030800, rc 0) 00000100:00100000:3.0:1788587844.975786:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:11310:x1875470026078208:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 784us (1059us total) trans 0 rc 301/301 00000100:00100000:3.0:1788587844.975794:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 139 00000100:00080000:1.0:1788587844.976175:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587844.982574:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587844.982680:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026078464 00000100:00100000:2.0:1788587844.982692:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026078464 00000100:00100000:2.0:1788587844.982763:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 140 00000100:00100000:2.0:1788587844.982776:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:11310:x1875470026078464:12345-192.168.206.33@tcp:36:lfs.0 00010000:00010000:2.0:1788587844.982897:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587844.982932:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5800/0xa13e120d54ca8581 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db114e expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.982955:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44900) 00010000:00010000:2.0:1788587844.982962:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587844.983246:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.983261:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8bd9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1307 expref: 5 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.983271:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.983318:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1307 expref: 5 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.983335:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1307 expref: 5 pid: 8471 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587844.983353:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8471:1875470043908864:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587844.983465:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486647480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587844.990390:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8471:1875470043908864:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587844.990430:0:8471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587844.994223:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587844.994293:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026078592 00000100:00100000:3.0:1788587844.994308:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026078592 00000100:00080000:2.0:1788587844.994451:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587844.994530:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1307 expref: 6 pid: 8471 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587844.994624:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 61 00000100:00100000:3.0:1788587844.994635:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b66627bb-533c-4cf5-aca4-320057d76d08+6:2345:x1875470026078592:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587844.994669:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587844.994677:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1307 expref: 6 pid: 8471 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.994693:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1307 expref: 6 pid: 8471 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.994721:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8bd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1307 expref: 6 pid: 8471 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.994742:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44900) 00010000:00010000:3.0:1788587844.994748:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.994760:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.994769:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587844.994807:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587844.994910:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026078592:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 277us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587844.994919:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 61 00010000:00010000:2.0:1788587844.995029:0:8471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.995039:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.995067:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c1f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.995079:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.995088:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587844.996286:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788587844.996304:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.996314:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.996329:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.996335:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587844.996340:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.996348:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.996365:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f484d44900) 00010000:00010000:2.0:1788587844.996368:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587844.996373:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587844.996380:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c18 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587844.996405:0:8471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050588144 reply state 000000008cc59a6f transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587844.996415:0:8471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587844.996510:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:11310:x1875470026078464:12345-192.168.206.33@tcp:36:lfs.0 Request processed in 13733us (13947us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788587844.996520:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 140 00010000:00010000:0.0:1788587845.002980:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.003003:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c1f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.003012:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c1f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.003019:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159cc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587845.003039:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c1f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.003050:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c1f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.003071:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88f488834b00) 00010000:00010000:0.0:1788587845.003075:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587845.003081:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c1f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.003089:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c1f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.071520:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587845.111149:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587845.112363:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026078720 00000100:00100000:1.0:1788587845.112382:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026078720 00000100:00100000:1.0:1788587845.112584:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 141 00000100:00100000:1.0:1788587845.112597:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+14:11318:x1875470026078720:12345-192.168.206.33@tcp:101:lctl.0 00010000:00010000:1.0:1788587845.112629:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587845.112659:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8c26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db131c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.112743:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8c2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.112760:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8c2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.112775:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8c2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587845.112822:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587845.112826:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587845.112876:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8c2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.112906:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8c26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db131c expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.112929:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8c2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db131c expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.112959:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37300) 00010000:00010000:1.0:1788587845.112963:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587845.112968:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1000, rc 0) 00000100:00100000:1.0:1788587845.113050:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:11318:x1875470026078720:12345-192.168.206.33@tcp:101:lctl.0 Request processed in 456us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587845.113058:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 141 00000100:00100000:2.0:1788587845.196976:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587845.197347:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026078848 00000100:00100000:3.0:1788587845.197360:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026078848 00000100:00100000:3.0:1788587845.197440:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 142 00000100:00100000:3.0:1788587845.197452:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+15:11324:x1875470026078848:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:3.0:1788587845.197498:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587845.197540:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8c34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1323 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.197630:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.197646:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.197659:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.197677:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.197685:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.197692:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198008:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8c49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198017:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198024:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587845.198057:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788587845.198066:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587845.198090:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198104:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198111:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198120:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198126:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587845.198131:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198138:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198151:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37300) 00010000:00010000:3.0:1788587845.198154:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587845.198160:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198166:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8c3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198180:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198186:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198201:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198206:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587845.198209:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198214:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198221:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88f484d44600) 00010000:00010000:3.0:1788587845.198223:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587845.198226:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.198231:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8c42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.199554:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8c34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1323 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.199585:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1323 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.199595:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:3.0:1788587845.199598:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788587845.199603:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031800, rc 0) 00000100:00100000:3.0:1788587845.199701:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:11324:x1875470026078848:12345-192.168.206.33@tcp:101:bash.0 Request processed in 2250us (2738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587845.199732:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 142 00000100:00100000:1.0:1788587845.206157:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587845.206253:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026079104 00000100:00100000:2.0:1788587845.206265:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026079104 00000100:00100000:2.0:1788587845.206367:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 143 00000100:00100000:2.0:1788587845.206378:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:11324:x1875470026079104:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:2.0:1788587845.206403:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587845.206429:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8c50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db132a expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.206780:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c57 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.206798:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.206812:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.207113:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.207136:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.207148:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587845.207974:0:8471:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788587845.208150:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8c65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.208162:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.208172:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.208221:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.208229:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c57 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.208236:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.208241:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587845.208245:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.208253:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c57 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.208265:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:2.0:1788587845.208268:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587845.208273:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.208279:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8c57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587845.208292:0:8471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef36b5c2 reply state 00000000c195e54d transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587845.208300:0:8471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788587845.208335:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8c50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db132a expref: 19 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.208361:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8c65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db132a expref: 18 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.208369:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834f00) 00010000:00010000:2.0:1788587845.208372:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587845.208374:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159da00, rc 0) 00000100:00100000:2.0:1788587845.208450:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:11324:x1875470026079104:12345-192.168.206.33@tcp:101:bash.0 Request processed in 2073us (2305us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788587845.208458:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 143 00010000:00010000:1.0:1788587845.212375:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587845.212395:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00010000:00010000:1.0:1788587845.212404:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.212416:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.212423:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159cc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587845.212430:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.212439:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.212464:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f488834700) 00010000:00010000:1.0:1788587845.212468:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587845.212479:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.212488:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8c5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587845.212493:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026079232 00000100:00100000:0.0:1788587845.212504:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026079232 00000100:00100000:0.0:1788587845.212591:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 47 00000100:00100000:0.0:1788587845.212603:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026079232:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:0.0:1788587845.212620:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587845.212640:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca8c73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1331 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587845.212665:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587845.212683:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=292s v=(0 0) 00010000:00010000:0.0:1788587845.212688:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587845.212698:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca8c73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1331 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.212730:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca8c73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1331 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.212756:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b200, rc 0) 00000100:00100000:0.0:1788587845.212806:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2345:x1875470026079232:12345-192.168.206.33@tcp:101:bash.0 Request processed in 206us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587845.212812:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 47 00000100:00080000:2.0:1788587845.213087:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587845.221132:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587845.221237:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026079360 00000100:00100000:0.0:1788587845.221247:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026079360 00000100:00100000:0.0:1788587845.221307:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 48 00000100:00100000:0.0:1788587845.221317:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:11324:x1875470026079360:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:0.0:1788587845.221333:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587845.221351:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1338 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.221381:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca8c73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1331 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.221390:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587845.221394:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587845.221399:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.221431:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca8c73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1331 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.221444:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca8c73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1331 expref: 7 pid: 6694 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587845.221471:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1875470043908992:192.168.206.33@tcp:104: 00000100:00100000:0.0:1788587845.221575:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48341ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587845.227642:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587845.227884:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1875470043908992:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587845.227940:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.227966:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a200, rc 0) 00000100:00100000:0.0:1788587845.228040:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:11324:x1875470026079360:12345-192.168.206.33@tcp:101:bash.0 Request processed in 6724us (6917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587845.228050:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 48 00000100:00100000:1.0:1788587845.231638:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026079488 00000100:00100000:1.0:1788587845.231661:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026079488 00010000:00010000:1.0:1788587845.232278:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca8c73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1331 expref: 7 pid: 6694 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587845.232447:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 62 00000100:00100000:1.0:1788587845.232465:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2344:x1875470026079488:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587845.232488:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587845.232516:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca8c73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1331 expref: 7 pid: 6694 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.232542:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca8c73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1331 expref: 7 pid: 6694 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.232570:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca8c73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1331 expref: 7 pid: 6694 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.232591:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587845.232596:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587845.232606:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.232617:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.232683:0:6708:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587845.232699:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48576ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6708:1875470043909120:192.168.206.33@tcp:105: 00000100:00100000:1.0:1788587845.232921:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48575d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587845.239805:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587845.239866:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026079744 00000100:00100000:3.0:1788587845.239877:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026079744 00000100:00100000:3.0:1788587845.239948:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 36 00000100:00100000:3.0:1788587845.239960:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+18:11324:x1875470026079744:12345-192.168.206.33@tcp:35:bash.0 00000100:00100000:3.0:1788587845.240430:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:11324:x1875470026079744:12345-192.168.206.33@tcp:35:bash.0 Request processed in 470us (638us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788587845.240438:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 36 00000100:00100000:0.0:1788587845.243276:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48576ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6708:1875470043909120:192.168.206.33@tcp:105: 00010000:00010000:0.0:1788587845.243311:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587845.245353:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2344:x1875470026079488:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 12877us (17709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587845.245370:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 62 00000100:00100000:3.0:1788587845.310692:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587845.310824:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026080000 00000100:00100000:1.0:1788587845.310887:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026080000 00000100:00100000:1.0:1788587845.310979:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 144 00000100:00100000:1.0:1788587845.310991:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:11333:x1875470026080000:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587845.311027:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587845.311057:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8c81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db133f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587845.311177:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788587845.311343:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8c81 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db133f expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.311362:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37300) 00010000:00010000:1.0:1788587845.311365:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587845.311371:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca8c81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db133f expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.311390:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1c00, rc 0) 00000100:00100000:1.0:1788587845.311473:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:11333:x1875470026080000:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 485us (796us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1788587845.311501:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 144 00000100:00100000:2.0:1788587845.317126:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587845.317224:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026080256 00000100:00100000:3.0:1788587845.317236:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026080256 00000100:00100000:3.0:1788587845.317305:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 37 00000100:00100000:3.0:1788587845.317318:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:11333:x1875470026080256:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:3.0:1788587845.317815:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:11333:x1875470026080256:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 496us (702us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788587845.317825:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 37 00000100:00100000:3.0:1788587845.404188:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587845.404483:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026080384 00000100:00100000:0.0:1788587845.404497:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026080384 00000100:00100000:0.0:1788587845.404579:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 145 00000100:00100000:0.0:1788587845.404591:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:11340:x1875470026080384:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587845.404623:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587845.404651:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8c8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1346 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.404767:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8c96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.404785:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.404800:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587845.404909:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788587845.404914:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587845.404937:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.404969:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8c8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1346 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.404991:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8c96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1346 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.405001:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:0.0:1788587845.405004:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587845.405009:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a400, rc 0) 00000100:00100000:0.0:1788587845.405096:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:11340:x1875470026080384:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 508us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587845.405104:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 145 00000100:00100000:1.0:1788587845.413757:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587845.413898:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026080640 00000100:00100000:2.0:1788587845.413921:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026080640 00000100:00100000:2.0:1788587845.413996:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 146 00000100:00100000:2.0:1788587845.414010:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48576ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:11340:x1875470026080640:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:2.0:1788587845.414034:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587845.414060:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8c9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db134d expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.414191:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.414208:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.414244:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587845.414258:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788587845.414631:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8c9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db134d expref: 25 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.414658:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db134d expref: 24 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.414669:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834f00) 00010000:00010000:2.0:1788587845.414673:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587845.414678:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159ce00, rc 0) 00000100:00100000:2.0:1788587845.414764:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48576ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:11340:x1875470026080640:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 757us (1020us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788587845.414773:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 146 00000100:00100000:2.0:1788587845.417947:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587845.418114:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026080896 00000100:00100000:3.0:1788587845.418128:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026080896 00000100:00100000:3.0:1788587845.418206:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 147 00000100:00100000:3.0:1788587845.418219:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:11340:x1875470026080896:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587845.418250:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587845.418277:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8cb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1354 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.418432:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8cb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.418451:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.418464:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587845.418479:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788587845.418646:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8cb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1354 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.418668:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1354 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.418678:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834f00) 00010000:00010000:3.0:1788587845.418681:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788587845.418685:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030600, rc 0) 00000100:00100000:3.0:1788587845.418764:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:11340:x1875470026080896:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 547us (832us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788587845.418773:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 147 00000100:00100000:3.0:1788587845.424444:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587845.424563:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026081024 00000100:00100000:0.0:1788587845.424578:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026081024 00000100:00100000:0.0:1788587845.424676:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:0.0:1788587845.424689:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:2346:x1875470026081024:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587845.424710:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587845.424742:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db134d expref: 26 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.424768:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834f00) 00010000:00010000:0.0:1788587845.424774:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587845.424903:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+25:2346:x1875470026081024:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 209us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587845.424912:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:1.0:1788587845.427411:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587845.427574:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026081152 00000100:00100000:3.0:1788587845.427587:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026081152 00000100:00100000:3.0:1788587845.427657:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 49 00000100:00100000:3.0:1788587845.427668:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2345:x1875470026081152:12345-192.168.206.33@tcp:1:lfs.0 00010000:00010000:3.0:1788587845.427751:0:9214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca8cc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.427777:0:9214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.427787:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587845.427791:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587845.427796:0:9214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca8cc7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.427878:0:9214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.427905:0:9214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 6 pid: 6695 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587845.427920:0:9214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9214:1875470043909248:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587845.428035:0:9214:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4918de540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587845.431558:0:9214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9214:1875470043909248:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587845.431599:0:9214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca8cc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587845.435099:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587845.435477:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026081280 00000100:00100000:2.0:1788587845.435490:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026081280 00002000:00100000:2.0:1788587845.435826:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff88f4b4c97b80 x1875470026081280/t0(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:406/0 lens 504/0 e 0 to 0 dl 1788587856 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587845.435838:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4b4c97b80 with x1875470026081280 ext(0->12) 00010000:00010000:2.0:1788587845.436081:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 7 pid: 6695 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.436103:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 7 pid: 6695 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587845.436132:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88f4b4c97b80 00000100:00100000:2.0:1788587845.436220:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 2 00000100:00100000:2.0:1788587845.436232:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2344:x1875470026081280:12345-192.168.206.33@tcp:4:lfs.0 00000100:00100000:2.0:1788587845.438071:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2344:x1875470026081280:12345-192.168.206.33@tcp:4:lfs.0 Request processed in 1828us (2976us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788587845.438087:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 2 00002000:00100000:2.0:1788587845.438103:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff88f4b4c97b80 x1875470026081280/t4294967305(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:406/0 lens 504/448 e 0 to 0 dl 1788587856 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587845.438115:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4b4c97b80 with x1875470026081280 ext(0->12) 00010000:00010000:2.0:1788587845.438128:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 9 pid: 6695 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.438151:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 9 pid: 6695 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587845.438160:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88f4b4c97b80 00000100:00100000:2.0:1788587845.444294:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587845.449226:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026081408 00000100:00100000:1.0:1788587845.449320:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026081408 00010000:00010000:1.0:1788587845.449394:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 9 pid: 6695 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587845.449441:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 63 00000100:00100000:1.0:1788587845.449451:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2344:x1875470026081408:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587845.449472:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788587845.449497:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788587845.449500:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788587844 00002000:00010000:1.0:1788587845.449502:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788587844 00002000:00010000:1.0:1788587845.449504:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788587844 00010000:00010000:1.0:1788587845.449511:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 9 pid: 6695 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.449603:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 9 pid: 6695 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.449635:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8c7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1338 expref: 9 pid: 6695 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.449658:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587845.449681:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587845.449689:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca8cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.449700:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca8cc7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.449745:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587845.449888:0:9214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca8cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.449925:0:9214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca8cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.449962:0:9214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca8cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.449971:0:9214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca8cc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.449980:0:9214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca8cc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.449987:0:9214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030800 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:3.0:1788587845.449993:0:9214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca8cc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.450004:0:9214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca8cc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.450019:0:9214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca8cc7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.450037:0:9214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca8cc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587845.450102:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026081408:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 651us (5822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587845.450111:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 63 00000100:00100000:3.0:1788587845.450694:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2345:x1875470026081152:12345-192.168.206.33@tcp:1:lfs.0 Request processed in 23023us (23291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587845.450705:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 49 00000100:00100000:2.0:1788587845.457975:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587845.458379:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026081664 00000100:00100000:1.0:1788587845.458394:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026081664 00000100:00100000:1.0:1788587845.458470:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 38 00000100:00100000:1.0:1788587845.458482:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+25:11340:x1875470026081664:12345-192.168.206.33@tcp:35:lfs.0 00000004:00010000:1.0:1788587845.458576:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1354 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587845.458962:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788587845.459010:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788587845.459983:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788587845.460072:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.460096:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8c65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db132a expref: 29 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.460106:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.460164:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8c65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db132a expref: 29 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.460182:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8c65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db132a expref: 29 pid: 8471 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587845.460200:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf5e4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875470043909376:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587845.461724:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48575d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587845.485191:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587845.485293:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026081792 00000100:00100000:2.0:1788587845.485637:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026081792 00000100:00100000:1.0:1788587845.485647:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf5e4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875470043909376:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587845.485680:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.485685:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8c65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db132a expref: 30 pid: 8471 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587845.485731:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 64 00000100:00100000:2.0:1788587845.485771:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:2345:x1875470026081792:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587845.486419:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587845.486433:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8c65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db132a expref: 30 pid: 8471 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.486451:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8c65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db132a expref: 30 pid: 8471 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.486479:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8c65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db132a expref: 30 pid: 8471 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.486500:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834f00) 00010000:00010000:2.0:1788587845.486507:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.486518:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.486527:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.486571:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587845.486616:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.486624:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587845.486639:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+29:2345:x1875470026081792:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 870us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587845.486647:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 64 00000001:00080000:1.0:1788587845.486804:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788587845.487081:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788587845.487200:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf5e4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875470043909504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788587845.487446:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587845.487483:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043909504 00000100:00100000:1.0:1788587845.487487:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48575d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587845.487490:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043909504 00000100:00100000:2.0:1788587845.487584:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587845.487593:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875470043909504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788587845.487713:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875470043909504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 121us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587845.487720:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788587845.488400:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf5e4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875470043909504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788587845.495570:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1788587845.495715:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf5e4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875470043909632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788587845.496480:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587845.496607:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48575d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587845.496663:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043909632 00000100:00100000:3.0:1788587845.496672:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043909632 00000100:00100000:3.0:1788587845.497043:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587845.497055:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875470043909632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788587845.504273:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875470043909632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 7206us (7780us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788587845.504291:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788587845.508278:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf5e4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875470043909632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788587845.508430:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788587845.508510:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.508522:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.508541:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.508548:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587845.508554:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.508563:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.508584:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834f00) 00010000:00010000:1.0:1788587845.508588:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788587845.508595:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.508602:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8cce lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788587845.509444:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788587845.509588:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788587845.509603:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 292764760324ns, next at 293764756911ns, rc = 0 00000001:00080000:1.0:1788587845.509634:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788587845.509688:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834f00) 00010000:00010000:1.0:1788587845.509693:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788587845.509704:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca8cb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1354 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587845.510039:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11340:x1875470026081664:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 51558us (52079us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788587845.510051:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 38 00000020:00080000:1.0:1788587845.510058:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788587845.517231:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587845.517408:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026081920 00000100:00100000:3.0:1788587845.517421:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026081920 00000100:00100000:3.0:1788587845.517492:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 148 00000100:00100000:3.0:1788587845.517505:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11340:x1875470026081920:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587845.517548:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587845.517578:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8cd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db135b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.517655:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8cd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db135b expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.517675:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8cd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db135b expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587845.517698:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:3.0:1788587845.517717:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587845.517722:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030800, rc 0) 00000100:00100000:3.0:1788587845.517810:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:11340:x1875470026081920:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 308us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587845.517817:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 148 00000100:00100000:0.0:1788587845.520508:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587845.521232:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026082176 00000100:00100000:3.0:1788587845.521247:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026082176 00000100:00100000:3.0:1788587845.521334:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 39 00000100:00100000:3.0:1788587845.521354:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:11340:x1875470026082176:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:3.0:1788587845.521701:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+34:11340:x1875470026082176:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 355us (1205us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788587845.521709:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 39 00000100:00100000:0.0:1788587845.576185:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587845.576308:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587845.576348:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043909888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587845.576453:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587845.576563:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043909888 00000100:00100000:1.0:1788587845.576575:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043909888 00000100:00100000:1.0:1788587845.576651:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788587845.576663:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043909888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587845.576720:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587845.576771:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043909888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587845.576779:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788587845.576828:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788587845.576835:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88f4bf727b80, transno 4294967312 00000100:00100000:1.0:1788587845.576894:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4c1943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043909888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587845.584384:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043910144:0@lo:400:kworker.0 00000100:00100000:0.0:1788587845.584491:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587845.584738:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043910016:0@lo:400:kworker.0 00000100:00100000:1.0:1788587845.584909:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043909760:0@lo:400:kworker.0 00000100:00100000:1.0:1788587845.584982:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587845.585048:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587845.585061:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043910272:0@lo:400:kworker.0 00000100:00100000:1.0:1788587845.585098:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043909760 00000100:00100000:1.0:1788587845.585106:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043909760 00000100:00100000:1.0:1788587845.585164:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788587845.585174:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043909760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587845.585235:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043909760:12345-0@lo:400:kworker.0 Request processed in 62us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587845.585243:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788587845.585461:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587845.585496:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043910144 00000100:00100000:0.0:1788587845.585501:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043910144 00000100:00100000:0.0:1788587845.585556:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043910016 00000100:00100000:0.0:1788587845.585560:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043910016 00000100:00100000:0.0:1788587845.585581:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788587845.585588:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043910144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587845.585625:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043910144:12345-0@lo:400:kworker.0 Request processed in 39us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587845.585632:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788587845.585655:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788587845.585662:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043910016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587845.585694:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043910016:12345-0@lo:400:kworker.0 Request processed in 34us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587845.585700:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788587845.585741:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043910016:0@lo:400:kworker.0 00000100:00100000:1.0:1788587845.590621:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043910144:0@lo:400:kworker.0 00000100:00080000:1.0:1788587845.590683:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587845.590691:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587845.590744:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587845.590810:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043909760:0@lo:400:kworker.0 00000100:00100000:1.0:1788587845.590858:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043910272 00000100:00100000:1.0:1788587845.590866:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043910272 00000100:00100000:1.0:1788587845.590932:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788587845.590941:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043910272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587845.591018:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043910272:12345-0@lo:400:kworker.0 Request processed in 78us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587845.591036:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1788587845.591057:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587845.591073:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043910272:0@lo:400:kworker.0 00000100:00100000:0.0:1788587845.626536:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587845.626719:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026082432 00000100:00100000:2.0:1788587845.626732:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026082432 00000100:00100000:2.0:1788587845.626819:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 149 00000100:00100000:2.0:1788587845.626833:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+34:11350:x1875470026082432:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:2.0:1788587845.626896:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587845.626927:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8cdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1362 expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587845.627312:0:7276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788587845.627468:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8cdc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1362 expref: 36 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.627486:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37300) 00010000:00010000:2.0:1788587845.627490:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587845.627497:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8cdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1362 expref: 36 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.627514:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159da00, rc 0) 00000100:00100000:2.0:1788587845.628346:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+35:11350:x1875470026082432:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 1513us (1839us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788587845.628355:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 149 00000100:00100000:0.0:1788587845.643236:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587845.646874:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026082560 00000100:00100000:2.0:1788587845.646895:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026082560 00000100:00100000:2.0:1788587845.646985:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 150 00000100:00100000:2.0:1788587845.647015:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+35:11350:x1875470026082560:12345-192.168.206.33@tcp:34:lfs.0 00010000:00010000:2.0:1788587845.647194:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8cea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647215:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8cea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647229:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8cea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647249:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8cf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647255:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647262:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647367:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8cf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647376:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647383:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587845.647433:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647447:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8cea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647462:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8cea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647469:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8cea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647475:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159da00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587845.647480:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8cea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647488:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8cea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647502:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:2.0:1788587845.647505:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587845.647511:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8cea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647916:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8cea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647934:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647940:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8cf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647946:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647951:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159dc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587845.647963:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647970:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647978:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f488834f00) 00010000:00010000:2.0:1788587845.647982:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587845.647985:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8cf1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.647991:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8cf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.648009:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.648016:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8cf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.648021:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.648179:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587845.648182:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.648188:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.648197:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:2.0:1788587845.648199:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587845.648208:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8cf8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.648214:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8cf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587845.648374:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+35:11350:x1875470026082560:12345-192.168.206.33@tcp:34:lfs.0 Request processed in 1357us (5148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587845.648385:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 150 00000100:00100000:1.0:1788587845.651353:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587845.651449:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026082816 00000100:00100000:3.0:1788587845.651462:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026082816 00000100:00100000:3.0:1788587845.651546:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 40 00000100:00100000:3.0:1788587845.651558:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+35:11350:x1875470026082816:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:3.0:1788587845.652199:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:11350:x1875470026082816:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 640us (858us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788587845.652210:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 40 00000100:00100000:1.0:1788587845.711016:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587845.711228:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026083072 00000100:00100000:0.0:1788587845.711240:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026083072 00000100:00100000:0.0:1788587845.711317:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 151 00000100:00100000:0.0:1788587845.711329:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bb25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:11353:x1875470026083072:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587845.711359:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587845.711385:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8cff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1369 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.711477:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8d06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.711495:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8d06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.711509:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8d06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.711537:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8d0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.711545:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.711561:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.711704:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8d14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.711713:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.711720:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587845.711729:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788587845.712299:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8d06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.712311:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8d06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.712318:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8d06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.712324:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587845.712330:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8d06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.712339:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8d06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.712354:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:0.0:1788587845.712358:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587845.712374:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8d06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.712382:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8d06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.712399:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.712405:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8d0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.712411:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8d0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.712416:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587845.712419:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8d0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.712425:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8d0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.712434:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f489033500) 00010000:00010000:0.0:1788587845.712436:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587845.712439:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8d0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.712445:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8d0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.712500:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8cff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1369 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.714096:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8d14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1369 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587845.714109:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:0.0:1788587845.714113:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587845.714117:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b000, rc 0) 00000100:00100000:0.0:1788587845.714304:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bb25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+38:11353:x1875470026083072:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 2974us (3299us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788587845.714315:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 151 00000100:00100000:0.0:1788587845.719946:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587845.720106:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026083200 00000100:00100000:2.0:1788587845.720120:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026083200 00000100:00100000:2.0:1788587845.720188:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 152 00000100:00100000:2.0:1788587845.720200:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+38:11353:x1875470026083200:12345-192.168.206.33@tcp:54:lfs.0 00010000:00010000:2.0:1788587845.720288:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.720310:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.720324:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.720359:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.720366:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8d22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.720373:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8d22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.720381:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159dc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587845.720403:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8d22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.720413:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8d22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.720426:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:2.0:1788587845.720429:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587845.720434:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8d22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.720441:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8d22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587845.720579:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+38:11353:x1875470026083200:12345-192.168.206.33@tcp:54:lfs.0 Request processed in 380us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587845.720588:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 152 00000100:00100000:2.0:1788587845.724026:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587845.724131:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026083456 00000100:00100000:1.0:1788587845.724143:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026083456 00000100:00100000:1.0:1788587845.724248:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 41 00000100:00100000:1.0:1788587845.724260:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+38:11353:x1875470026083456:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:1.0:1788587845.724580:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+39:11353:x1875470026083456:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 322us (567us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788587845.724589:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 41 00000100:00100000:1.0:1788587845.953349:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587845.954158:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026083712 00000100:00100000:2.0:1788587845.954173:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026083712 00000100:00100000:2.0:1788587845.954251:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 153 00000100:00100000:2.0:1788587845.954266:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+39:11384:x1875470026083712:12345-192.168.206.33@tcp:101:cat.0 00010000:00010000:2.0:1788587845.954298:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587845.954325:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8d29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1370 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.954451:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.954468:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.954502:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587845.955677:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788587845.956382:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8d29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1370 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.956411:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1370 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587845.956420:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:2.0:1788587845.956424:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587845.956428:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159da00, rc 0) 00000100:00100000:2.0:1788587845.957354:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+41:11384:x1875470026083712:12345-192.168.206.33@tcp:101:cat.0 Request processed in 3082us (4014us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788587845.957365:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 153 00000100:00100000:0.0:1788587845.962006:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587845.962280:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026083840 00000100:00100000:1.0:1788587845.962292:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026083840 00000100:00100000:1.0:1788587845.962412:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 12 00000100:00100000:1.0:1788587845.962424:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+41:2345:x1875470026083840:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587845.962448:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587845.962480:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1370 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587845.962512:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:1.0:1788587845.962525:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587845.962607:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+40:2345:x1875470026083840:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 185us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587845.962615:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 12 00000100:00100000:3.0:1788587845.963139:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587845.963183:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026084096 00000100:00100000:3.0:1788587845.963189:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026084096 00000100:00100000:3.0:1788587845.963231:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 42 00000100:00100000:3.0:1788587845.963239:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+40:11384:x1875470026084096:12345-192.168.206.33@tcp:35:cat.0 00000100:00100000:3.0:1788587845.963828:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+41:11384:x1875470026084096:12345-192.168.206.33@tcp:35:cat.0 Request processed in 273us (377us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788587845.963875:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 42 00000100:00100000:3.0:1788587846.016151:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587846.016429:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026084352 00000100:00100000:0.0:1788587846.016445:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026084352 00000100:00100000:0.0:1788587846.016565:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 154 00000100:00100000:0.0:1788587846.016581:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+41:11390:x1875470026084352:12345-192.168.206.33@tcp:101:dd.0 00010000:00010000:0.0:1788587846.016613:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587846.016617:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788587846.016650:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8c96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1346 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.016676:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:0.0:1788587846.016682:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587846.016698:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8d3e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1377 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.016896:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.016930:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8d14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1369 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.016939:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.016980:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8d14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1369 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.016997:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8d14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1369 expref: 41 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587846.017014:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043910400:192.168.206.33@tcp:104: 00000100:00100000:0.0:1788587846.017149:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48341ccc0 going to sleep for 11 seconds 00000100:00080000:1.0:1788587846.017303:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587846.021641:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587846.021721:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026084480 00000100:00100000:3.0:1788587846.021732:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026084480 00010000:00010000:3.0:1788587846.021784:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8d14 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1369 expref: 42 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587846.021833:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 65 00000100:00100000:3.0:1788587846.021877:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+42:2344:x1875470026084480:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587846.021896:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587846.021904:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8d14 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1369 expref: 42 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587846.021920:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8d14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1369 expref: 42 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587846.021949:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:3.0:1788587846.021955:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587846.021966:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587846.021975:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587846.021998:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587846.022276:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+42:2344:x1875470026084480:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 431us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587846.022304:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 65 00010000:00010000:2.0:1788587846.023967:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8d14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1369 expref: 41 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587846.023996:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043910400:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587846.024094:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.024108:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.024115:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587846.024165:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788587846.024535:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8d3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1377 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.024557:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1377 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.024568:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:2.0:1788587846.024571:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587846.024575:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77ae00, rc 0) 00000100:00100000:2.0:1788587846.024660:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+41:11390:x1875470026084352:12345-192.168.206.33@tcp:101:dd.0 Request processed in 8083us (8523us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788587846.024669:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 154 00000100:00100000:0.0:1788587846.027227:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587846.027325:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026084736 00000100:00100000:2.0:1788587846.027492:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026084736 00000100:00100000:2.0:1788587846.027618:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 155 00000100:00100000:2.0:1788587846.027632:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+41:11390:x1875470026084736:12345-192.168.206.33@tcp:36:dd.0 00010000:00010000:2.0:1788587846.028033:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.028055:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.028068:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587846.028133:0:7276:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788587846.028180:0:7276:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b39c42d reply state 00000000b1d815c8 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587846.028190:0:7276:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587846.028318:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+44:11390:x1875470026084736:12345-192.168.206.33@tcp:36:dd.0 Request processed in 687us (1102us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788587846.028328:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 155 00000020:00080000:2.0:1788587846.028334:0:7276:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788587846.043728:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.043750:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.043758:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.043765:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159da00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587846.043771:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.043780:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.043801:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:2.0:1788587846.043804:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587846.043810:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.043816:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159da00/0xa13e120d54ca8d53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.090773:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587846.117927:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587846.117970:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587846.118002:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587846.118044:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026084992 00000100:00100000:3.0:1788587846.118057:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026084992 00000100:00100000:3.0:1788587846.118134:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 66 00000100:00100000:3.0:1788587846.118146:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2345:x1875470026084992:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587846.118234:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2345:x1875470026084992:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 90us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587846.118243:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 66 00000100:00080000:3.0:1788587846.118271:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587846.119345:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026085120 00000100:00100000:2.0:1788587846.119393:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026085120 00000100:00100000:2.0:1788587846.119470:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 135 00000100:00100000:2.0:1788587846.119492:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026085120:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587846.119592:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b66627bb-533c-4cf5-aca4-320057d76d08+5:2345:x1875470026085120:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 112us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587846.119600:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 135 00000100:00080000:3.0:1788587846.119920:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587846.121237:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026084864 00000100:00100000:1.0:1788587846.121375:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026084864 00000100:00100000:1.0:1788587846.121619:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 287 00000100:00100000:1.0:1788587846.121631:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026084864:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587846.121731:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026084864:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 102us (3818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587846.121740:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 287 00000001:00080000:1.0:1788587846.169269:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000001:00080000:1.0:1788587846.169635:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000004:00080000:1.0:1788587846.169651:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788587846.169683:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88f48575d840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788587846.169688:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f488f1f300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88f48575dc00 00000020:00080000:1.0:1788587846.169692:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f486603300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88f4bf6e7800 00000020:00080000:0.0:1788587846.169730:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788587846.169988:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:1.0:1788587846.170241:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000100:00100000:1.0:1788587846.170303:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043910528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788587846.170635:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587846.170798:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043910528 00000100:00100000:0.0:1788587846.170807:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043910528 00000100:00100000:0.0:1788587846.170906:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788587846.170918:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875470043910528:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1788587846.170923:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1788587846.170953:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1788587846.170997:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9baf44, atime: 0x6a9baf44, ctime: 0x6a9baf44, blocks: 0x1 00010000:00010000:0.0:1788587846.171007:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8d5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.171241:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=293s v=(0 0) 00010000:00010000:0.0:1788587846.171246:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587846.171255:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8d5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.171275:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8d5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.171286:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8d5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.171295:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8d5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.171365:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788587846.172112:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1875470043910528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1194us (1474us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788587846.172124:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:1.0:1788587846.172608:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88f4bab6e300/2, rc 0, transno 4294967307 00000100:00100000:1.0:1788587846.172616:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043910528:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788587846.172689:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587846.172699:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8d5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.172711:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a200 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587846.172717:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8d5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.172729:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8d5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.172750:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8d5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.172757:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca8d5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.172785:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587846.172787:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587846.172789:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587846.308777:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587846.308929:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026085248 00000100:00100000:2.0:1788587846.308962:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026085248 00000100:00100000:2.0:1788587846.309041:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 156 00000100:00100000:2.0:1788587846.309053:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+16:11404:x1875470026085248:12345-192.168.206.33@tcp:101:stat.0 00010000:00010000:2.0:1788587846.309082:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587846.309109:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8d61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db137e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.309230:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8d68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.309256:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.309270:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.309287:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8d6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.309295:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.309311:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.309688:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8d76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.309703:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1377 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.309712:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8d76 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.309761:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1377 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.309777:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1377 expref: 17 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587846.309792:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043910656:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587846.309975:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486647000 going to sleep for 11 seconds 00000100:00100000:2.0:1788587846.315180:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587846.315362:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043910656:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587846.315410:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8d76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587846.315832:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026085504 00000100:00100000:1.0:1788587846.315882:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026085504 00000100:00100000:1.0:1788587846.315955:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 43 00000100:00100000:1.0:1788587846.315966:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+18:5585:x1875470026085504:12345-192.168.206.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788587846.317035:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:5585:x1875470026085504:12345-192.168.206.33@tcp:35:ldlm_bl.0 Request processed in 1061us (1861us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788587846.317048:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 43 00000100:00100000:0.0:1788587846.323897:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587846.324146:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026085632 00000100:00100000:2.0:1788587846.324160:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026085632 00010000:00010000:2.0:1788587846.324718:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1377 expref: 19 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587846.325682:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 66 00000100:00100000:2.0:1788587846.325705:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:2345:x1875470026085632:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587846.325728:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587846.325740:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1377 expref: 19 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.325757:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1377 expref: 19 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.325786:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca8d45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1377 expref: 19 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.325830:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:2.0:1788587846.325837:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8d76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.326002:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.326012:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8d76 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.326061:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587846.326145:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+18:2345:x1875470026085632:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 451us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587846.326154:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 66 00010000:00010000:0.0:1788587846.327506:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327559:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587846.327629:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788587846.327635:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587846.327663:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327683:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327695:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327702:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8d68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327710:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8d68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327717:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159de00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587846.327722:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8d68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327730:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8d68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327749:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:0.0:1788587846.327752:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587846.327758:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8d68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327776:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8d68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327798:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327804:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8d6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327810:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327816:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587846.327819:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327825:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8d6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327833:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f488834700) 00010000:00010000:0.0:1788587846.327836:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587846.327839:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8d6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327887:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8d6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327942:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8d61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db137e expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327957:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db137e expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.327976:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:0.0:1788587846.327978:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587846.327981:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159ce00, rc 0) 00000100:00100000:0.0:1788587846.328086:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+17:11404:x1875470026085248:12345-192.168.206.33@tcp:101:stat.0 Request processed in 19033us (19324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587846.328094:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 156 00000100:00100000:0.0:1788587846.397970:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587846.398094:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026085888 00000100:00100000:2.0:1788587846.398107:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026085888 00000100:00100000:2.0:1788587846.398183:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 157 00000100:00100000:2.0:1788587846.398195:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4833a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+17:11410:x1875470026085888:12345-192.168.206.33@tcp:36:truncate.0 00010000:00010000:2.0:1788587846.398269:0:7276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587846.398303:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8d76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db137e expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.398328:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:2.0:1788587846.398334:0:7276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587846.398695:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8d7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.398712:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8d7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.398739:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8d7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587846.398794:0:7276:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788587846.398817:0:7276:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000df46fa5 reply state 00000000c3b4efa4 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8d7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587846.398826:0:7276:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587846.399122:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4833a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:11410:x1875470026085888:12345-192.168.206.33@tcp:36:truncate.0 Request processed in 924us (1160us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788587846.399132:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 157 00000020:00080000:2.0:1788587846.399139:0:7276:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788587846.405697:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8d7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587846.405721:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8d7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587846.405730:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8d7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587846.405737:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587846.405743:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8d7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587846.405753:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8d7d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587846.405794:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:3.0:1788587846.405798:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587846.405805:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8d7d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587846.405813:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8d7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587846.601204:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587846.601333:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026086016 00000100:00100000:2.0:1788587846.601461:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026086016 00000100:00100000:2.0:1788587846.601566:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 158 00000100:00100000:2.0:1788587846.601577:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+18:11424:x1875470026086016:12345-192.168.206.33@tcp:101:stat.0 00010000:00010000:2.0:1788587846.601601:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587846.601620:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8d84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1385 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.601695:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8d8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.601710:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8d8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.601721:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8d8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.601748:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8d92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.601756:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.601765:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602185:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8d99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602194:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602202:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587846.602238:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788587846.602242:0:8471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587846.602264:0:8471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602276:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602284:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8d8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602291:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8d8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602309:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8d8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602315:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587846.602319:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8d8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602327:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8d8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602480:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:2.0:1788587846.602484:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587846.602489:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8d8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602497:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8d8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602511:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602517:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8d92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602533:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602539:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587846.602542:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602559:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8d92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602568:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f488834f00) 00010000:00010000:2.0:1788587846.602570:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587846.602573:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8d92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602579:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8d92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602612:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8d84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1385 expref: 20 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602624:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8d99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1385 expref: 19 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.602631:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:2.0:1788587846.602689:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587846.602693:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d000, rc 0) 00000100:00100000:2.0:1788587846.602755:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:11424:x1875470026086016:12345-192.168.206.33@tcp:101:stat.0 Request processed in 1179us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587846.602765:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 158 00000001:00080000:3.0:1788587846.644655:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1788587846.644688:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1788587846.719131:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587846.721955:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026086272 00000100:00100000:2.0:1788587846.721968:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026086272 00000100:00100000:2.0:1788587846.722328:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 159 00000100:00100000:2.0:1788587846.722339:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:11434:x1875470026086272:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:2.0:1788587846.722373:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587846.722392:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8da0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db138c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587846.722477:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788587846.722611:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8da0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db138c expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.722625:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37300) 00010000:00010000:2.0:1788587846.722629:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587846.722634:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8da0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db138c expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.722649:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159ce00, rc 0) 00000100:00100000:2.0:1788587846.722723:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:11434:x1875470026086272:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 386us (3602us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788587846.722730:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 159 00000100:00100000:1.0:1788587846.726873:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587846.726952:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026086528 00000100:00100000:3.0:1788587846.726963:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026086528 00000100:00100000:3.0:1788587846.727024:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 44 00000100:00100000:3.0:1788587846.727036:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ad2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:11434:x1875470026086528:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:3.0:1788587846.727281:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ad2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:11434:x1875470026086528:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 246us (416us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788587846.727289:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 44 00000100:00100000:1.0:1788587846.814424:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587846.814518:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026086784 00000100:00100000:0.0:1788587846.814539:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026086784 00000100:00100000:0.0:1788587846.814600:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 160 00000100:00100000:0.0:1788587846.814610:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bacbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:11440:x1875470026086784:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:0.0:1788587846.814635:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587846.814667:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8dae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1393 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.814763:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.814777:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8d99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1385 expref: 22 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.814786:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.814833:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8d99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1385 expref: 22 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.814885:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8d99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1385 expref: 22 pid: 8471 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587846.814899:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4f84700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043910784:192.168.206.33@tcp:104: 00000100:00100000:0.0:1788587846.814986:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48341c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587846.817137:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4f84700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043910784:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587846.817162:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587846.827913:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587846.831374:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026086912 00000100:00100000:0.0:1788587846.831389:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026086912 00010000:00010000:0.0:1788587846.831454:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8d99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1385 expref: 23 pid: 8471 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587846.831628:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 67 00000100:00100000:0.0:1788587846.831639:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+23:2344:x1875470026086912:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587846.831653:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587846.831659:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8d99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1385 expref: 23 pid: 8471 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.831672:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8d99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1385 expref: 23 pid: 8471 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.831695:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8d99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1385 expref: 23 pid: 8471 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.831712:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:0.0:1788587846.831717:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.831742:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.831749:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.831789:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587846.832157:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:2344:x1875470026086912:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 518us (4252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587846.832166:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 67 00010000:00010000:2.0:1788587846.832237:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.832245:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587846.832262:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788587846.832469:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8dae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1393 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.832660:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1393 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.832671:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:2.0:1788587846.832674:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587846.832681:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77bc00, rc 0) 00000100:00100000:2.0:1788587846.832711:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bacbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:11440:x1875470026086784:12345-192.168.206.33@tcp:101:bash.0 Request processed in 18103us (18297us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788587846.832718:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 160 00000100:00100000:0.0:1788587846.836821:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587846.836952:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026087168 00000100:00100000:2.0:1788587846.836961:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026087168 00000100:00100000:2.0:1788587846.837015:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 161 00000100:00100000:2.0:1788587846.837035:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:11440:x1875470026087168:12345-192.168.206.33@tcp:36:bash.0 00010000:00010000:2.0:1788587846.837280:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8dc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.837296:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.837307:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587846.837357:0:8471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788587846.837383:0:8471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008788983 reply state 00000000685cb646 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587846.837392:0:8471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587846.837493:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+25:11440:x1875470026087168:12345-192.168.206.33@tcp:36:bash.0 Request processed in 445us (673us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788587846.837501:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 161 00000020:00080000:2.0:1788587846.837506:0:8471:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788587846.840360:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.840376:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8dc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.840384:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8dc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.840390:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587846.840395:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8dc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.840404:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8dc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.840420:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:2.0:1788587846.840423:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587846.840427:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8dc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.840434:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8dc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587846.848219:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587846.848786:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026087296 00000100:00100000:2.0:1788587846.848796:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026087296 00000100:00100000:2.0:1788587846.849074:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 162 00000100:00100000:2.0:1788587846.849086:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:11440:x1875470026087296:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:2.0:1788587846.849124:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587846.849143:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8dca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db139a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.849223:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8dd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.849236:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1393 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.849244:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8dd1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.849274:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1393 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.849286:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1393 expref: 25 pid: 5842 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587846.849298:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043910912:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587846.849377:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4866473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587846.851268:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043910912:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587846.851294:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8dd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587846.855695:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587846.857014:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026087424 00000100:00100000:1.0:1788587846.857037:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026087424 00010000:00010000:1.0:1788587846.857081:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1393 expref: 26 pid: 5842 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587846.857132:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 68 00000100:00100000:1.0:1788587846.857142:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:2344:x1875470026087424:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587846.857156:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587846.857162:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1393 expref: 26 pid: 5842 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587846.857176:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1393 expref: 26 pid: 5842 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587846.857199:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8db5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1393 expref: 26 pid: 5842 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587846.857213:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:1.0:1788587846.857219:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8dd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587846.857228:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587846.857235:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8dd1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587846.857269:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587846.857338:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+25:2344:x1875470026087424:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 190us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587846.857360:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 68 00010000:00010000:0.0:1788587846.858000:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.858011:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587846.858065:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788587846.858069:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587846.858087:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.858119:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8dca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db139a expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.858135:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db139a expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587846.858158:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:0.0:1788587846.858161:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587846.858164:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159c000, rc 0) 00000100:00100000:0.0:1788587846.858204:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:11440:x1875470026087296:12345-192.168.206.33@tcp:101:bash.0 Request processed in 9121us (9994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587846.858212:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 162 00000100:00100000:1.0:1788587846.867136:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587846.867208:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026087680 00000100:00100000:3.0:1788587846.867216:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026087680 00000100:00100000:3.0:1788587846.867265:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 45 00000100:00100000:3.0:1788587846.867273:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:11440:x1875470026087680:12345-192.168.206.33@tcp:35:bash.0 00000100:00100000:3.0:1788587846.867475:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+25:11440:x1875470026087680:12345-192.168.206.33@tcp:35:bash.0 Request processed in 202us (347us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788587846.867483:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 45 00000100:00100000:1.0:1788587846.959120:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587846.959241:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026087936 00000100:00100000:2.0:1788587846.959254:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026087936 00000100:00100000:2.0:1788587846.959349:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 163 00000100:00100000:2.0:1788587846.959381:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+25:11450:x1875470026087936:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:2.0:1788587846.959418:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587846.959458:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8dd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db13a1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587846.959589:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788587846.959755:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8dd8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13a1 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.959772:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37300) 00010000:00010000:2.0:1788587846.959776:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587846.959782:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8dd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13a1 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.959800:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159c200, rc 0) 00000100:00100000:2.0:1788587846.959944:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:11450:x1875470026087936:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 566us (847us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788587846.959952:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 163 00000100:00100000:0.0:1788587846.965942:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587846.966114:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026088064 00000100:00100000:2.0:1788587846.966127:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026088064 00000100:00100000:2.0:1788587846.966202:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 164 00000100:00100000:2.0:1788587846.966214:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:11450:x1875470026088064:12345-192.168.206.33@tcp:34:lfs.0 00010000:00010000:2.0:1788587846.966312:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8de6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.966334:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.966374:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.966392:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8ded lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.966400:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.966406:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.966993:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8df4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967006:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967189:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587846.967249:0:7276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967264:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967271:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8de6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967279:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967296:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587846.967301:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967309:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8de6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967324:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:2.0:1788587846.967328:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587846.967334:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8de6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967341:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8de6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967358:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967365:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8ded lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967371:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967376:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587846.967380:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967386:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8ded lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967406:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f488834f00) 00010000:00010000:2.0:1788587846.967409:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587846.967412:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8ded lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967418:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8ded lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967435:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967441:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8df4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967447:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8df4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967453:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159cc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587846.967456:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8df4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967462:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8df4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967469:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:2.0:1788587846.967471:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587846.967474:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8df4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587846.967480:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8df4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587846.967738:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:11450:x1875470026088064:12345-192.168.206.33@tcp:34:lfs.0 Request processed in 1521us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587846.967748:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 164 00000100:00100000:1.0:1788587846.971689:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587846.971797:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026088320 00000100:00100000:3.0:1788587846.971811:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026088320 00000100:00100000:1.0:1788587846.973193:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 46 00000100:00100000:1.0:1788587846.973218:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:11450:x1875470026088320:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:1.0:1788587846.973810:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+27:11450:x1875470026088320:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 602us (2206us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788587846.973820:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 46 00000100:00100000:1.0:1788587847.016333:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587847.017042:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026088576 00000100:00100000:0.0:1788587847.017056:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026088576 00000100:00100000:0.0:1788587847.017280:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 165 00000100:00100000:0.0:1788587847.017294:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+27:11453:x1875470026088576:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587847.017327:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587847.017356:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8dfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db13a8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.017479:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.017496:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.017511:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.017542:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.017551:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.017574:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.018725:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8e10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.018745:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.018755:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587847.018768:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788587847.018916:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.018925:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.018932:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.018939:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77ba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587847.018943:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.018952:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.018966:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:0.0:1788587847.018970:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587847.018985:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.018992:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.019008:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.019013:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.019019:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.019024:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587847.019027:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.019032:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.019040:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f489033e00) 00010000:00010000:0.0:1788587847.019042:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587847.019045:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.019050:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.019243:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8dfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13a8 expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.019274:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13a8 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.019282:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:0.0:1788587847.019284:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587847.019287:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b400, rc 0) 00000100:00100000:0.0:1788587847.019541:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+29:11453:x1875470026088576:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 2248us (3221us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788587847.019551:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 165 00000100:00100000:0.0:1788587847.025283:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587847.025401:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587847.025633:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026088832 00000100:00100000:1.0:1788587847.025648:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026088832 00000100:00100000:1.0:1788587847.025736:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 13 00000100:00100000:1.0:1788587847.025748:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+29:2346:x1875470026088832:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587847.025767:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587847.025800:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8e10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13a8 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587847.025824:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:1.0:1788587847.025831:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587847.025930:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+28:2346:x1875470026088832:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 184us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587847.025939:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 13 00000100:00100000:2.0:1788587847.026284:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026088704 00000100:00100000:2.0:1788587847.026291:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026088704 00000100:00100000:2.0:1788587847.026385:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 166 00000100:00100000:2.0:1788587847.026395:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+28:11453:x1875470026088704:12345-192.168.206.33@tcp:54:lfs.0 00010000:00010000:2.0:1788587847.026471:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.026490:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.026501:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.026546:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.026554:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.026562:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.026569:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159cc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587847.026575:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.026583:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.026611:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:2.0:1788587847.026614:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587847.026870:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.026880:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587847.026946:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+28:11453:x1875470026088704:12345-192.168.206.33@tcp:54:lfs.0 Request processed in 551us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587847.026954:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 166 00000100:00100000:0.0:1788587847.029975:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587847.030146:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026089088 00000100:00100000:1.0:1788587847.030225:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026089088 00000100:00100000:1.0:1788587847.030357:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 47 00000100:00100000:1.0:1788587847.030371:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+28:11453:x1875470026089088:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:1.0:1788587847.030929:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+29:11453:x1875470026089088:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 558us (1159us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788587847.030940:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 47 00010000:00010000:0.0:1788587847.112967:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587847.192636:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587847.192726:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026089344 00000100:00100000:2.0:1788587847.192739:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026089344 00000100:00100000:2.0:1788587847.192918:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 167 00000100:00100000:2.0:1788587847.192931:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+29:11471:x1875470026089344:12345-192.168.206.33@tcp:101:cat.0 00010000:00010000:2.0:1788587847.192965:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587847.192993:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db13af expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.193121:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8e2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.193139:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8e2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.193152:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8e2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587847.193165:0:7276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788587847.193354:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13af expref: 32 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.193388:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8e2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13af expref: 31 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.193398:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:2.0:1788587847.193402:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788587847.193407:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d600, rc 0) 00000100:00100000:2.0:1788587847.193490:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:11471:x1875470026089344:12345-192.168.206.33@tcp:101:cat.0 Request processed in 562us (867us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788587847.193498:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 167 00000100:00100000:3.0:1788587847.215121:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587847.215472:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026089472 00000100:00100000:0.0:1788587847.215486:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026089472 00000100:00100000:0.0:1788587847.215575:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 168 00000100:00100000:0.0:1788587847.215588:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:11472:x1875470026089472:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587847.215622:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587847.215652:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8e3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db13b6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.215743:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.215760:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.215811:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587847.215900:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788587847.215905:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587847.215927:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.215962:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8e3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13b6 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.215986:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13b6 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.215995:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:0.0:1788587847.215998:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587847.216004:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a800, rc 0) 00000100:00100000:0.0:1788587847.216088:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11472:x1875470026089472:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 502us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587847.216096:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 168 00000100:00100000:3.0:1788587847.222192:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587847.222305:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026089856 00000100:00100000:2.0:1788587847.222318:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026089856 00000100:00100000:2.0:1788587847.222390:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 48 00000100:00100000:2.0:1788587847.222403:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11472:x1875470026089856:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:2.0:1788587847.222882:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:11472:x1875470026089856:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 443us (666us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788587847.222891:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 48 00000100:00100000:1.0:1788587847.228541:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587847.230861:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026089984 00000100:00100000:0.0:1788587847.230880:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026089984 00000100:00100000:0.0:1788587847.231074:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 14 00000100:00100000:0.0:1788587847.231095:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:11472:x1875470026089984:12345-192.168.206.33@tcp:103:lfs.0 00010000:00010000:0.0:1788587847.231124:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788587847.231157:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8dd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db139a expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.231212:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca8e2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13af expref: 32 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.231225:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8cd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db135b expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.231239:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f484d44600) 00010000:00010000:0.0:1788587847.231255:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587847.231352:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:11472:x1875470026089984:12345-192.168.206.33@tcp:103:lfs.0 Request processed in 260us (2834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587847.231361:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 14 00000100:00100000:3.0:1788587847.234471:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587847.235069:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026090112 00000100:00100000:2.0:1788587847.235083:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026090112 00000100:00100000:2.0:1788587847.235236:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 169 00000100:00100000:2.0:1788587847.235248:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:11472:x1875470026090112:12345-192.168.206.33@tcp:58:lfs.0 00010000:00010000:2.0:1788587847.235582:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e48 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.235603:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587847.235636:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587847.237280:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788587847.238125:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:11472:x1875470026090112:12345-192.168.206.33@tcp:58:lfs.0 Request processed in 2869us (3656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587847.238141:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 169 00000100:00100000:3.0:1788587847.264496:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587847.265583:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026090240 00000100:00100000:0.0:1788587847.265603:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026090240 00000100:00100000:0.0:1788587847.265909:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 170 00000100:00100000:0.0:1788587847.265922:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:11474:x1875470026090240:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587847.265950:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587847.265977:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8e4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db13bd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.266071:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.266101:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.266115:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.266316:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8e5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.266327:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8e5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.266335:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8e5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267228:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8e64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267244:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8e64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267252:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8e64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587847.267305:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788587847.267309:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587847.267332:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8e64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267345:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8e64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267354:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267362:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267380:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267387:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77ba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587847.267391:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267400:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267416:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:0.0:1788587847.267419:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587847.267425:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267432:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267448:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8e5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267454:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8e5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267461:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8e5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267466:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587847.267469:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8e5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267571:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8e5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267581:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f489033e00) 00010000:00010000:0.0:1788587847.267584:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587847.267588:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8e5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267594:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8e5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267653:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8e4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13bd expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267667:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8e64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13bd expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587847.267674:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834f00) 00010000:00010000:0.0:1788587847.267676:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587847.267679:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b200, rc 0) 00000100:00100000:0.0:1788587847.267772:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:11474:x1875470026090240:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 1853us (3290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587847.267791:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 170 00000040:00080000:1.0:1788587848.008290:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587848.008304:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587848.008352:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:1.0:1788587848.008361:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587848.009329:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5334a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875470043911040:192.168.206.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788587848.009472:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7f0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587848.011951:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5334a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875470043911040:192.168.206.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788587848.014639:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587848.014807:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026090368 00000100:00100000:0.0:1788587848.014820:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026090368 00000100:00100000:0.0:1788587848.014952:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 171 00000100:00100000:0.0:1788587848.014966:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:11485:x1875470026090368:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788587848.015037:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788587848.015237:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:11485:x1875470026090368:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 Request processed in 274us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587848.015246:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 171 00000100:00080000:3.0:1788587848.015951:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587848.018192:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587848.018441:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026090496 00000100:00100000:2.0:1788587848.018455:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026090496 00000100:00100000:2.0:1788587848.018626:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 172 00000100:00100000:2.0:1788587848.018640:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4c1942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:11485:x1875470026090496:12345-192.168.206.33@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788587848.018756:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8e6b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.018778:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8e6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.018795:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8e6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.018813:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8e72 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.018821:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8e72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.018827:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8e72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.018893:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8e79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.018922:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8e79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.018931:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8e79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587848.018988:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788587848.018993:0:8471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587848.019008:0:8471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8e79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019144:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8e6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019153:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8e6b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019160:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8e6b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019167:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587848.019172:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8e6b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019182:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8e6b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019196:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44800) 00010000:00010000:2.0:1788587848.019200:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587848.019206:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8e6b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019225:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8e6b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019243:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8e72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019249:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8e72 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019255:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8e72 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019260:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587848.019264:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8e72 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019270:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8e72 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019279:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff88f488834100) 00010000:00010000:2.0:1788587848.019281:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587848.019284:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8e72 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019290:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8e72 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019308:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8e79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019314:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8e79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019326:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8e79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019332:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587848.019335:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8e79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019341:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8e79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019349:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834f00) 00010000:00010000:2.0:1788587848.019352:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587848.019355:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8e79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.019361:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8e79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587848.019561:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4c1942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:11485:x1875470026090496:12345-192.168.206.33@tcp:34:lhsmtool_posix.0 Request processed in 922us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587848.019571:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 172 00000100:00100000:1.0:1788587848.022671:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587848.022786:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026090752 00000100:00100000:0.0:1788587848.022799:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026090752 00000100:00100000:0.0:1788587848.022956:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 173 00000100:00100000:0.0:1788587848.022970:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:11485:x1875470026090752:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587848.022997:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587848.023025:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e80 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db13c4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.023180:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8e87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.023199:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.023215:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587848.023233:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788587848.023490:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.023499:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8e87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.023506:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.023540:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587848.023546:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.023555:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8e87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.023571:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834f00) 00010000:00010000:0.0:1788587848.023574:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587848.023579:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8e87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.023586:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8e87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.023639:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e80 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13c4 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.023650:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44800) 00010000:00010000:0.0:1788587848.023652:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587848.023656:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8e80 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13c4 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.023666:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77ba00, rc 0) 00000100:00100000:0.0:1788587848.023756:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11485:x1875470026090752:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 789us (1098us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788587848.023764:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 173 00000100:00100000:3.0:1788587848.027059:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587848.027200:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026090880 00000100:00100000:2.0:1788587848.027213:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026090880 00000100:00100000:2.0:1788587848.027315:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 174 00000100:00100000:2.0:1788587848.027327:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11485:x1875470026090880:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788587848.027385:0:7276:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587848.027550:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11485:x1875470026090880:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 Request processed in 225us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587848.027568:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 174 00000100:00100000:3.0:1788587848.031581:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587848.031967:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026091136 00000100:00100000:2.0:1788587848.031981:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026091136 00000100:00100000:2.0:1788587848.032065:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 175 00000100:00100000:2.0:1788587848.032078:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38385ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11485:x1875470026091136:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587848.032104:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587848.032108:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788587848.032142:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8e41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13b6 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.032169:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:2.0:1788587848.032175:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587848.032192:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8e95 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db13cb expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788587848.037784:0:8471:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788587848.038207:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8e9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.038230:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.038246:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.038352:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8e95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13cb expref: 34 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.038545:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8e9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13cb expref: 33 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.038557:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88f484d44400) 00010000:00010000:3.0:1788587848.038560:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587848.038565:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030200, rc 0) 00000100:00100000:2.0:1788587848.038757:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38385ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:11485:x1875470026091136:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 6679us (7187us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788587848.038768:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 175 00000100:00100000:0.0:1788587848.044224:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587848.044305:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026091392 00000100:00100000:2.0:1788587848.044319:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026091392 00000100:00100000:2.0:1788587848.044397:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 176 00000100:00100000:2.0:1788587848.044410:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:11485:x1875470026091392:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587848.044558:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587848.044683:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8e9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13cb expref: 33 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.044719:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88f484d44400) 00010000:00010000:2.0:1788587848.044735:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587848.044765:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8eaa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.044781:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8eaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.044792:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8eaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.044808:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8eb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb3bbf42 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.044815:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb3bbf42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.044821:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb3bbf42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.045158:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8eaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.045167:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8eaa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.045175:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8eaa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.045181:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587848.045186:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8eaa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.045201:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8eaa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.045212:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:2.0:1788587848.045215:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587848.045219:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8eaa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.045225:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca8eaa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.045236:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb3bbf42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.045241:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8eb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb3bbf42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.045247:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8eb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb3bbf42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.045252:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587848.045255:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8eb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb3bbf42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.045261:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8eb1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb3bbf42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.045268:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb3bbf42 (ffff88f488834100) 00010000:00010000:2.0:1788587848.045270:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587848.045273:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8eb1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb3bbf42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.045288:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8eb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb3bbf42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587848.045406:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11485:x1875470026091392:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 999us (1197us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788587848.045415:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 176 00000100:00100000:3.0:1788587848.050285:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587848.050790:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026091520 00000100:00100000:2.0:1788587848.050805:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026091520 00000100:00100000:2.0:1788587848.050896:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 177 00000100:00100000:2.0:1788587848.050909:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11485:x1875470026091520:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587848.050939:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587848.050970:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8eb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db13d2 expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.051023:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ebf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.051040:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.051054:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.051182:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8eb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d2 expref: 34 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.051207:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d2 expref: 33 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.051231:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88f488834400) 00010000:00010000:2.0:1788587848.051234:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587848.051238:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d800, rc 0) 00000100:00100000:2.0:1788587848.051326:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:11485:x1875470026091520:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 420us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587848.051335:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 177 00000100:00100000:1.0:1788587848.059722:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587848.059890:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026091776 00000100:00100000:2.0:1788587848.059904:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026091776 00000100:00100000:2.0:1788587848.059981:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 178 00000100:00100000:2.0:1788587848.059995:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+33:11485:x1875470026091776:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587848.060110:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ec6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.060135:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.060149:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587848.061949:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1788587848.061978:0:8471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 295317134802ns, next at 296317130242ns, rc = 0 00000004:00010000:2.0:1788587848.062143:0:8471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050ae6f49 reply state 00000000f60feb9a transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587848.062228:0:8471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587848.062457:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+35:11485:x1875470026091776:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 2461us (2745us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788587848.062506:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 178 00010000:00010000:3.0:1788587848.068862:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.068898:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ec6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.068908:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ec6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.068916:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587848.068922:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ec6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.068932:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ec6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587848.068950:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00010000:00010000:3.0:1788587848.068954:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88f488834400) 00010000:00010000:3.0:1788587848.068959:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788587848.068965:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ec6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.068973:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8ec6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587848.072541:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026091904 00000100:00100000:2.0:1788587848.072557:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026091904 00000100:00100000:2.0:1788587848.072635:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 179 00000100:00100000:2.0:1788587848.072648:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+34:11485:x1875470026091904:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587848.072677:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587848.072704:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8ecd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db13d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.072797:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8ecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d9 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.072818:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8ecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d9 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.072863:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88f488834400) 00010000:00010000:2.0:1788587848.072867:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587848.072872:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d400, rc 0) 00000100:00100000:2.0:1788587848.072968:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+35:11485:x1875470026091904:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 322us (4024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587848.072977:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 179 00000100:00100000:1.0:1788587848.083193:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587848.083297:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026092032 00000100:00100000:3.0:1788587848.083310:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026092032 00000100:00100000:3.0:1788587848.083403:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 51 00000100:00100000:3.0:1788587848.083416:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2344:x1875470026092032:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788587848.083913:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2344:x1875470026092032:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 Request processed in 498us (731us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788587848.083924:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 51 00000100:00080000:1.0:1788587848.084144:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587848.089717:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587848.089816:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026092288 00000100:00100000:3.0:1788587848.089837:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026092288 00000100:00100000:2.0:1788587848.089953:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 49 00000100:00100000:2.0:1788587848.089967:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+35:11485:x1875470026092288:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788587848.090278:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:11485:x1875470026092288:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 Request processed in 313us (575us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788587848.090294:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 49 00000100:00100000:3.0:1788587848.092060:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587848.092122:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026092544 00000100:00100000:0.0:1788587848.092133:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026092544 00000100:00100000:0.0:1788587848.092212:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 180 00000100:00100000:0.0:1788587848.092224:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:11485:x1875470026092544:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788587848.092367:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:11485:x1875470026092544:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 144us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587848.092376:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 180 00000100:00100000:3.0:1788587848.097359:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587848.097565:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026092672 00000100:00100000:2.0:1788587848.097580:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026092672 00000100:00100000:2.0:1788587848.097656:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 181 00000100:00100000:2.0:1788587848.097669:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:11485:x1875470026092672:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587848.097699:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587848.097728:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8ed4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db13e0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.097835:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8edb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.097883:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.097897:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587848.097948:0:8471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587848.097973:0:8471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.098009:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca8ed4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13e0 expref: 38 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.098106:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8edb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13e0 expref: 37 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.098126:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88f488834400) 00010000:00010000:2.0:1788587848.098136:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788587848.098141:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159dc00, rc 0) 00000100:00100000:2.0:1788587848.098436:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:11485:x1875470026092672:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 767us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587848.098444:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 181 00000100:00100000:3.0:1788587848.103656:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587848.104584:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026092800 00000100:00100000:0.0:1788587848.104602:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026092800 00000100:00100000:0.0:1788587848.104749:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 52 00000100:00100000:0.0:1788587848.104762:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2346:x1875470026092800:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587848.104917:0:9214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587848.104949:0:9214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca8ee2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db13e7 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587848.104985:0:9214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9baf46, blocks: 0x1 00010000:00010000:0.0:1788587848.105010:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=295s v=(0 0) 00010000:00010000:0.0:1788587848.105015:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587848.105027:0:9214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca8ee2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13e7 expref: 8 pid: 9214 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.105050:0:9214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca8ee2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13e7 expref: 8 pid: 9214 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.105206:0:9214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77ba00, rc 0) 00000100:00100000:0.0:1788587848.105894:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2346:x1875470026092800:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 1128us (2247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587848.105905:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 52 00000100:00100000:0.0:1788587848.114312:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587848.114716:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026093056 00000100:00100000:1.0:1788587848.114730:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026093056 00000100:00100000:1.0:1788587848.114804:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 182 00000100:00100000:1.0:1788587848.114817:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:11485:x1875470026093056:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788587848.114993:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:11485:x1875470026093056:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 179us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587848.115002:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 182 00000100:00100000:3.0:1788587848.122372:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587848.123665:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026093184 00000100:00100000:0.0:1788587848.123683:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026093184 00000100:00100000:0.0:1788587848.123774:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 53 00000100:00100000:0.0:1788587848.123787:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:11485:x1875470026093184:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587848.123811:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587848.123835:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f876ed/0xa13e120d54ca8ee9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db13ee expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.123895:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca8ee2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13e7 expref: 9 pid: 9214 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.123907:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587848.123912:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587848.123918:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f876ed/0xa13e120d54ca8ee9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13ee expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.123961:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca8ee2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13e7 expref: 9 pid: 9214 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.123978:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca8ee2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13e7 expref: 9 pid: 9214 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587848.123995:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4f85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875470043911168:192.168.206.33@tcp:104: 00000100:00100000:0.0:1788587848.124142:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48575dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587848.127121:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587848.127243:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026093312 00000100:00100000:1.0:1788587848.127262:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026093312 00010000:00010000:1.0:1788587848.127311:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca8ee2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13e7 expref: 10 pid: 9214 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587848.127356:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 69 00000100:00100000:1.0:1788587848.127368:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383858380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:2344:x1875470026093312:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587848.127390:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587848.127422:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca8ee2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13e7 expref: 10 pid: 9214 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.127437:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca8ee2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13e7 expref: 10 pid: 9214 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.127474:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587848.127479:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587848.127491:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083f876ed/0xa13e120d54ca8ee9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13ee expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.127502:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f876ed/0xa13e120d54ca8ee9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13ee expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.127559:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000083f876ed/0xa13e120d54ca8ee9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13ee expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587848.127577:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5334380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875470043911296:192.168.206.33@tcp:105: 00000100:00100000:1.0:1788587848.127674:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7f0000 going to sleep for 11 seconds 00010000:00010000:0.0:1788587848.127895:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d13f2e95/0xa13e120d54ca8ee2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13e7 expref: 10 pid: 9214 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587848.127909:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4f85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875470043911168:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587848.127940:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083f876ed/0xa13e120d54ca8ee9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13ee expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.127952:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a400, rc 0) 00000100:00100000:0.0:1788587848.127987:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:11485:x1875470026093184:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 4204us (5885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587848.127996:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 53 00000100:00100000:1.0:1788587848.131655:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5334380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875470043911296:192.168.206.33@tcp:105: 00010000:00010000:1.0:1788587848.131688:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587848.131758:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383858380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026093312:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 4391us (4651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587848.131770:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 69 00010000:00010000:2.0:1788587848.137488:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587848.138692:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587848.140299:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026093440 00000100:00100000:2.0:1788587848.140320:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026093440 00002000:00100000:2.0:1788587848.140391:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff88f4b5334380 x1875470026093440/t0(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:409/0 lens 504/0 e 0 to 0 dl 1788587859 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587848.140404:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4b5334380 with x1875470026093440 ext(0->8) 00002000:00010000:2.0:1788587848.140411:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f4b5334380 00000100:00100000:2.0:1788587848.140450:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 4 00000100:00100000:2.0:1788587848.140463:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026093440:12345-192.168.206.33@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788587848.141107:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:2344:x1875470026093440:12345-192.168.206.33@tcp:4:lhsmtool_posix.0 Request processed in 633us (2412us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788587848.141119:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 4 00002000:00100000:2.0:1788587848.141128:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff88f4b5334380 x1875470026093440/t4294967314(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:409/0 lens 504/448 e 0 to 0 dl 1788587859 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587848.141138:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4b5334380 with x1875470026093440 ext(0->8) 00002000:00010000:2.0:1788587848.141142:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f4b5334380 00000100:00100000:3.0:1788587848.144184:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587848.144277:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026093568 00000100:00100000:1.0:1788587848.144289:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026093568 00000100:00100000:1.0:1788587848.144365:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 183 00000100:00100000:1.0:1788587848.144377:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:11485:x1875470026093568:12345-192.168.206.33@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788587848.202920:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:11485:x1875470026093568:12345-192.168.206.33@tcp:44:lhsmtool_posix.0 Request processed in 58528us (58733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587848.202937:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 183 00000001:00080000:1.0:1788587848.203567:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000020:00080000:1.0:1788587848.203589:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1788587848.203635:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1788587848.203644:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:2.0:1788587848.203899:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f48366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043911424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788587848.203983:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788587848.204164:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788587848.204183:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788587848.204249:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043911424 00000100:00100000:2.0:1788587848.204260:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043911424 00000100:00100000:2.0:1788587848.205236:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788587848.205250:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b51c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043911424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788587848.205529:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788587848.205534:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788587846 00002000:00010000:2.0:1788587848.205537:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788587848.205540:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788587846 -> 1788587846 00002000:00010000:2.0:1788587848.205543:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788587848.205632:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b51c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875470043911424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 385us (1652us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788587848.205641:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1788587848.205714:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88f48366e680/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788587848.205720:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f48366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043911424:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788587848.207391:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587848.211052:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587848.213527:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026093696 00000100:00100000:1.0:1788587848.213548:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026093696 00000100:00100000:1.0:1788587848.213671:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 55 00000100:00100000:1.0:1788587848.213684:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:2345:x1875470026093696:12345-192.168.206.33@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788587848.283806:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1788587848.283828:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1788587848.284217:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2345:x1875470026093696:12345-192.168.206.33@tcp:16:lhsmtool_posix.0 Request processed in 70527us (73168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587848.284232:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 55 00000040:00080000:1.0:1788587848.295696:0:12466:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587848.295708:0:12466:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587848.295764:0:12466:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:1.0:1788587848.295771:0:12466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788587848.297900:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587848.300289:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026093952 00000100:00100000:0.0:1788587848.300310:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026093952 00000100:00100000:0.0:1788587848.300403:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 184 00000100:00100000:0.0:1788587848.300416:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+18:11485:x1875470026093952:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587848.300492:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587848.300536:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8edb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13e0 expref: 18 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.300582:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88f488834400) 00010000:00010000:0.0:1788587848.300589:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587848.300639:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8ef0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.300656:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8ef0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.300669:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8ef0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587848.301039:0:8471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c76c18f reply state 00000000e3594105 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8ef0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587848.301051:0:8471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587848.301207:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:11485:x1875470026093952:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 792us (3319us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788587848.301217:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 184 00000100:00100000:1.0:1788587848.314601:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587848.315488:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026094080 00000100:00100000:3.0:1788587848.315505:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026094080 00000100:00100000:3.0:1788587848.315590:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 56 00000100:00100000:3.0:1788587848.315603:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2345:x1875470026094080:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788587848.315952:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788587848.315957:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788587846 -> 1788587845 00002000:00010000:3.0:1788587848.315961:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788587844 00002000:00010000:3.0:1788587848.315963:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788587846 -> 1788587845 00002000:00010000:3.0:1788587848.315966:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788587848.316049:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2345:x1875470026094080:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 Request processed in 447us (1463us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788587848.316070:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 56 00000100:00100000:3.0:1788587848.320404:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00010000:00010000:0.0:1788587848.320753:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8ef0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.320768:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8ef0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.320777:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8ef0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.320785:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587848.320790:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8ef0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.320816:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8ef0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.320837:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88f488834400) 00010000:00010000:0.0:1788587848.320965:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587848.320973:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8ef0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.320980:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8ef0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587848.321321:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026094336 00000100:00100000:1.0:1788587848.321341:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026094336 00000100:00100000:1.0:1788587848.321484:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 185 00000100:00100000:1.0:1788587848.321496:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38385a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+18:11485:x1875470026094336:12345-192.168.206.33@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788587848.321604:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.321622:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ebf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d2 expref: 18 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.321632:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.321674:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d2 expref: 18 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.321691:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ebf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d2 expref: 18 pid: 7276 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587848.321709:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5335c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043911552:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587848.321832:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49fadcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587848.326547:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5335c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043911552:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587848.326586:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587848.347879:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587848.348550:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026094464 00000100:00100000:2.0:1788587848.348569:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026094464 00010000:00010000:2.0:1788587848.348633:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ebf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d2 expref: 19 pid: 7276 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587848.348681:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 70 00000100:00100000:2.0:1788587848.348692:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383859880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:2344:x1875470026094464:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587848.348712:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587848.348720:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ebf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d2 expref: 19 pid: 7276 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.348736:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d2 expref: 19 pid: 7276 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.348764:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca8ebf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d2 expref: 19 pid: 7276 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.348799:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88f488834400) 00010000:00010000:2.0:1788587848.348805:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.348815:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.348824:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.348879:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587848.348941:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383859880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+18:2344:x1875470026094464:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 251us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587848.348948:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 70 00010000:00010000:1.0:1788587848.350639:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.350657:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.350719:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.350728:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.350736:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.350742:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587848.350747:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.350755:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.350775:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88f488834400) 00010000:00010000:1.0:1788587848.350778:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788587848.350783:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.350790:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca8ef7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587848.350922:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38385a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+17:11485:x1875470026094336:12345-192.168.206.33@tcp:55:lhsmtool_posix.0 Request processed in 29422us (30527us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788587848.350933:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 185 00000100:00100000:2.0:1788587848.354348:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587848.355491:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026094592 00000100:00100000:2.0:1788587848.355509:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026094592 00000100:00100000:2.0:1788587848.355593:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 57 00000100:00100000:2.0:1788587848.355605:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2345:x1875470026094592:12345-192.168.206.33@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788587848.355662:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca8efe lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.355689:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083f876ed/0xa13e120d54ca8ee9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13ee expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.355700:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587848.355705:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587848.355724:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca8efe lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.355769:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083f876ed/0xa13e120d54ca8ee9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13ee expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.355785:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083f876ed/0xa13e120d54ca8ee9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13ee expref: 8 pid: 6693 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587848.355802:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f3838a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875470043911680:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587848.355924:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4f7b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788587848.362354:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f3838a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875470043911680:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587848.362406:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca8efe lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587848.362610:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587848.362961:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026094720 00000100:00100000:0.0:1788587848.362970:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026094720 00010000:00010000:0.0:1788587848.363026:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083f876ed/0xa13e120d54ca8ee9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13ee expref: 9 pid: 6693 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587848.363067:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 71 00000100:00100000:0.0:1788587848.363078:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2344:x1875470026094720:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587848.363097:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587848.363129:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083f876ed/0xa13e120d54ca8ee9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13ee expref: 9 pid: 6693 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.363273:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083f876ed/0xa13e120d54ca8ee9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13ee expref: 9 pid: 6693 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.363310:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f876ed/0xa13e120d54ca8ee9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13ee expref: 9 pid: 6693 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.363337:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587848.363342:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587848.363348:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca8efe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.363359:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca8efe lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.363544:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587848.363614:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026094720:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 536us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587848.363622:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 71 00010000:00010000:2.0:1788587848.364932:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca8efe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.364949:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca8efe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.364992:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca8efe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.365000:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca8efe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.365020:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca8efe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.365027:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159da00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587848.365040:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca8efe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.365050:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca8efe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.365070:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca8efe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.365079:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca8efe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587848.365184:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2345:x1875470026094592:12345-192.168.206.33@tcp:1:lhsmtool_posix.0 Request processed in 9577us (10855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587848.365195:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 57 00000100:00100000:3.0:1788587848.379380:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587848.379550:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026094976 00000100:00100000:1.0:1788587848.379563:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026094976 00000100:00100000:1.0:1788587848.379640:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 186 00000100:00100000:1.0:1788587848.379661:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38385a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+17:11485:x1875470026094976:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788587848.379776:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8f05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.379799:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8f05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.379813:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8f05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.380318:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.380529:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8ecd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d9 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.380540:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.380583:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8ecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d9 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.380601:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8ecd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d9 expref: 18 pid: 5843 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587848.380617:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5335c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043911808:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587848.380724:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49fadc900 going to sleep for 11 seconds 00000100:00100000:0.0:1788587848.386585:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5335c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043911808:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587848.386625:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587848.388388:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587848.392576:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026095104 00000100:00100000:0.0:1788587848.392596:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026095104 00010000:00010000:0.0:1788587848.392655:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8ecd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d9 expref: 19 pid: 5843 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587848.392709:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 72 00000100:00100000:0.0:1788587848.392721:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:2344:x1875470026095104:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587848.392755:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587848.392763:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8ecd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d9 expref: 19 pid: 5843 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.392780:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8ecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d9 expref: 19 pid: 5843 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.392807:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca8ecd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13d9 expref: 19 pid: 5843 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.392826:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88f488834400) 00010000:00010000:0.0:1788587848.392832:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.392863:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.392872:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.392907:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587848.392981:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+18:2344:x1875470026095104:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 262us (4616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587848.392990:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 72 00010000:00010000:2.0:1788587848.401219:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.401243:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587848.401489:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1788587848.401673:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788587848.401721:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1788587848.401826:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f3838a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875470043911936:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788587848.401942:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587848.401986:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4f7b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587848.402097:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043911936 00000100:00100000:0.0:1788587848.402107:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043911936 00000100:00100000:0.0:1788587848.402169:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587848.402181:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875470043911936:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788587848.402266:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875470043911936:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587848.402279:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587848.402359:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788587848.402365:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88f48366e680, transno 4294967315 00000100:00100000:2.0:1788587848.402388:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f3838a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875470043911936:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788587848.403070:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788587848.403149:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f3838a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875470043912064:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788587848.403193:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587848.403223:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4f7b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788587848.403244:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043912064 00000100:00100000:2.0:1788587848.403249:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043912064 00000100:00100000:2.0:1788587848.403285:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587848.403292:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875470043912064:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788587848.403495:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1875470043912064:12345-0@lo:1000:mdt00_001.0 Request processed in 203us (300us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788587848.403503:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587848.403562:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f3838a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875470043912064:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788587848.403600:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403611:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403620:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403627:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587848.403633:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403641:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403667:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88f488834400) 00010000:00010000:2.0:1788587848.403671:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587848.403676:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403684:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8f0c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403718:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403726:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e48 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403732:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403737:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159cc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587848.403740:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403746:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e48 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403753:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834f00) 00010000:00010000:2.0:1788587848.403755:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587848.403758:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e48 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403765:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca8e48 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403800:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403817:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8e64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13bd expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403829:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403883:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8e64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13bd expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587848.403901:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8e64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13bd expref: 21 pid: 5842 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587848.403915:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f3838aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043912192:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587848.403992:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4f7b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587848.413385:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587848.413422:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026095232 00000100:00100000:3.0:1788587848.413442:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026095232 00010000:00010000:3.0:1788587848.413493:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8e64 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13bd expref: 22 pid: 5842 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587848.413549:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 73 00000100:00100000:3.0:1788587848.413560:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:2345:x1875470026095232:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587848.413579:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587848.413587:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8e64 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13bd expref: 22 pid: 5842 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.413603:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8e64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13bd expref: 22 pid: 5842 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.413632:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834f00) 00010000:00010000:3.0:1788587848.413639:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.413651:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.413660:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587848.413682:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587848.413744:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:2345:x1875470026095232:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 185us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587848.413752:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 73 00010000:00010000:0.0:1788587848.414406:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8e64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13bd expref: 21 pid: 5842 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587848.414424:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f3838aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875470043912192:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587848.414450:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414460:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414466:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414479:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414486:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414493:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414499:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159dc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587848.414504:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414522:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414535:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834f00) 00010000:00010000:0.0:1788587848.414547:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587848.414552:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414558:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159dc00/0xa13e120d54ca8f13 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414571:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8f05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414578:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8f05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414584:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8f05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414589:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587848.414592:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8f05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414598:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8f05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414607:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834f00) 00010000:00010000:0.0:1788587848.414609:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587848.414612:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8f05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587848.414618:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8f05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587848.415226:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38385a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:11485:x1875470026094976:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 35564us (35857us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1788587848.415249:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 186 00000020:00080000:0.0:1788587848.415255:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788587848.415611:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587848.415616:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788587848.419294:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000040:00080000:1.0:1788587848.419685:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788587848.419703:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587848.419957:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026095488 00000100:00100000:1.0:1788587848.419971:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026095488 00000100:00100000:1.0:1788587848.420043:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 50 00000100:00100000:1.0:1788587848.420056:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ad1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:11485:x1875470026095488:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788587848.420908:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788587848.421024:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788587848.421082:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8f1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.421103:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8f1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.421117:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8f1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.421127:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8f1a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.421134:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8f1a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.421141:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8f1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.421169:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788587848.421291:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ad1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:11485:x1875470026095488:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 Request processed in 1235us (2007us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788587848.421301:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 50 00000020:00080000:1.0:1788587848.421308:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788587848.421391:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587848.421399:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8f1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.421406:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0200 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587848.421412:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8f1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.421422:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8f1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.421436:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88f48fa37900) 00010000:00010000:1.0:1788587848.421440:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788587848.421445:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8f1a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.421451:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca8f1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587848.421471:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587848.421473:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587848.421475:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587849.160061:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587849.672108:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38385b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043912320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587849.672210:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587849.672528:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043912320 00000100:00100000:1.0:1788587849.672539:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043912320 00000100:00100000:1.0:1788587849.672624:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788587849.672636:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043912320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587849.672680:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788587849.672799:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587849.672976:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043912320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 341us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587849.672984:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788587849.673117:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1788587849.673125:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1788587849.673151:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88f4bab6e300, transno 4294967307 00000100:00100000:2.0:1788587849.673212:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38385b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043912320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788587850.188045:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587850.203102:0:12517:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587850.203112:0:12517:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587850.203156:0:12517:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:2.0:1788587850.203169:0:12517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788587850.298677:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587850.298756:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026095744 00000100:00100000:0.0:1788587850.298766:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026095744 00000100:00100000:0.0:1788587850.298922:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 187 00000100:00100000:0.0:1788587850.298933:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:11504:x1875470026095744:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587850.298955:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587850.298975:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8f21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db13f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.299065:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8f28 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.299079:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8f28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.299091:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8f28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587850.299102:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788587850.299210:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8f21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13f5 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.299229:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8f28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13f5 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.299238:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:0.0:1788587850.299247:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788587850.299253:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b000, rc 0) 00000100:00100000:0.0:1788587850.299306:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:11504:x1875470026095744:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 375us (637us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788587850.299314:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 187 00000100:00080000:2.0:1788587850.299790:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587850.304984:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587850.305058:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026095872 00000100:00100000:2.0:1788587850.305067:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026095872 00000100:00100000:2.0:1788587850.305124:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 188 00000100:00100000:2.0:1788587850.305134:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:11504:x1875470026095872:12345-192.168.206.33@tcp:34:lfs.0 00010000:00010000:2.0:1788587850.305204:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8f36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305221:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8f36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305234:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8f36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305248:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8f3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305255:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8f3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305260:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8f3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305518:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8f44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305527:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8f44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305535:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8f44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587850.305579:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8f44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305593:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8f36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305599:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8f36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305606:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8f36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305612:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587850.305616:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8f36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305624:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8f36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305636:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:2.0:1788587850.305639:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587850.305644:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8f36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305649:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159ce00/0xa13e120d54ca8f36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305660:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8f3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305665:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8f3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305677:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8f3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305682:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587850.305685:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8f3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305691:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8f3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305699:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f488834400) 00010000:00010000:2.0:1788587850.305701:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587850.305704:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8f3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305709:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c800/0xa13e120d54ca8f3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305724:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8f44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305729:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8f44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305735:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8f44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305740:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587850.305743:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8f44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305760:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8f44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305767:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f488834b00) 00010000:00010000:2.0:1788587850.305769:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587850.305772:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8f44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.305777:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca8f44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587850.305874:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:11504:x1875470026095872:12345-192.168.206.33@tcp:34:lfs.0 Request processed in 740us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587850.305882:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 188 00000100:00100000:3.0:1788587850.361213:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587850.361619:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026096128 00000100:00100000:0.0:1788587850.361629:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026096128 00000100:00100000:0.0:1788587850.361680:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 189 00000100:00100000:0.0:1788587850.361689:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38385b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:11507:x1875470026096128:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587850.361711:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587850.361731:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8f4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db13fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.361801:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8f52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.361815:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8f52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.361827:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8f52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.361858:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.361866:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.361873:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365588:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8f60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365607:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365619:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587850.365630:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788587850.365718:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8f52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365726:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8f52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365732:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8f52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365738:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587850.365743:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8f52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365750:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8f52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365761:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:0.0:1788587850.365764:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587850.365769:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8f52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365788:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca8f52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365801:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365807:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365812:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365817:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587850.365820:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365826:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365834:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f493d34000) 00010000:00010000:0.0:1788587850.365837:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587850.365854:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365862:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365911:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca8f4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13fc expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365925:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8f60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13fc expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.365939:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f493d34800) 00010000:00010000:0.0:1788587850.365942:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587850.365944:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77ba00, rc 0) 00000100:00100000:0.0:1788587850.366315:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38385b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:11507:x1875470026096128:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 4625us (5108us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788587850.366324:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 189 00000100:00100000:2.0:1788587850.376384:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587850.376520:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026096256 00000100:00100000:1.0:1788587850.376529:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026096256 00000100:00100000:1.0:1788587850.376578:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 190 00000100:00100000:1.0:1788587850.376587:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:11507:x1875470026096256:12345-192.168.206.33@tcp:54:lfs.0 00010000:00010000:1.0:1788587850.376647:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8f6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.376663:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.376675:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.376713:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.376720:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8f6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.376728:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8f6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.376734:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587850.376738:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8f6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.376746:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8f6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.376757:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f493d34800) 00010000:00010000:1.0:1788587850.376761:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587850.376774:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8f6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.376780:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca8f6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587850.376876:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:11507:x1875470026096256:12345-192.168.206.33@tcp:54:lfs.0 Request processed in 289us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587850.376884:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 190 00000100:00100000:0.0:1788587850.382185:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587850.382217:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026096512 00000100:00100000:0.0:1788587850.382226:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026096512 00000100:00100000:0.0:1788587850.382280:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 51 00000100:00100000:0.0:1788587850.382290:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:11507:x1875470026096512:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:0.0:1788587850.382592:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+27:11507:x1875470026096512:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 303us (413us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788587850.382600:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 51 00000100:00100000:1.0:1788587850.446677:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587850.448000:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026096768 00000100:00100000:2.0:1788587850.448013:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026096768 00000100:00100000:3.0:1788587850.453560:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 191 00000100:00100000:3.0:1788587850.453574:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+27:11033:x1875470026096768:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:3.0:1788587850.453597:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587850.453627:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8f75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1403 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.453718:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.453733:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8f60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13fc expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.453741:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.453772:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8f60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13fc expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.453784:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8f60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13fc expref: 28 pid: 5842 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587850.453798:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38385b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8471:1875470043912448:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587850.453919:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4908e1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587850.459838:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38385b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8471:1875470043912448:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587850.459902:0:8471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587850.460628:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587850.460876:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026096896 00000100:00100000:0.0:1788587850.460885:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026096896 00010000:00010000:0.0:1788587850.460926:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8f60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13fc expref: 29 pid: 5842 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587850.460963:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 74 00000100:00100000:0.0:1788587850.460972:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+29:2345:x1875470026096896:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587850.460988:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587850.461006:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8f60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13fc expref: 29 pid: 5842 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.461040:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8f60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13fc expref: 29 pid: 5842 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.461061:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca8f60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13fc expref: 29 pid: 5842 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.461077:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f493d34800) 00010000:00010000:0.0:1788587850.461082:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.461090:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.461098:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.461129:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587850.461187:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+28:2345:x1875470026096896:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 216us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587850.461195:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 74 00010000:00010000:1.0:1788587850.461519:0:8471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.461527:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587850.461545:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788587850.461691:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8f75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1403 expref: 29 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.461706:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1403 expref: 28 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.461714:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f493d34800) 00010000:00010000:1.0:1788587850.461716:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788587850.461719:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031000, rc 0) 00000100:00100000:1.0:1788587850.461758:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+28:11033:x1875470026096768:12345-192.168.206.33@tcp:101:bash.0 Request processed in 8188us (15090us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788587850.461765:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 191 00000100:00100000:1.0:1788587850.466683:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587850.466753:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026097152 00000100:00100000:0.0:1788587850.466762:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026097152 00000100:00100000:0.0:1788587850.466818:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 192 00000100:00100000:0.0:1788587850.466828:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+28:11033:x1875470026097152:12345-192.168.206.33@tcp:36:bash.0 00010000:00010000:0.0:1788587850.467106:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.467122:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.467143:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587850.467192:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788587850.467213:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3fdc74a reply state 00000000a3ee9b5e transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587850.467221:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788587850.467260:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788587850.467469:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11033:x1875470026097152:12345-192.168.206.33@tcp:36:bash.0 Request processed in 641us (862us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788587850.467476:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 192 00000020:00080000:0.0:1788587850.467480:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788587850.470794:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.470821:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.470829:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.470835:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587850.470879:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.470888:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.470903:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f493d34800) 00010000:00010000:3.0:1788587850.470906:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587850.470911:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.470917:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b200/0xa13e120d54ca8f8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587850.472075:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587850.472327:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026097280 00000100:00100000:2.0:1788587850.472336:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026097280 00000100:00100000:2.0:1788587850.472396:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 193 00000100:00100000:2.0:1788587850.472406:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:11033:x1875470026097280:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:2.0:1788587850.472436:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587850.472454:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8f91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db140a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.472520:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8f91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db140a expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.472554:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8f91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db140a expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.472575:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f493d34800) 00010000:00010000:2.0:1788587850.472578:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587850.472582:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159c200, rc 0) 00000100:00100000:2.0:1788587850.472653:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11033:x1875470026097280:12345-192.168.206.33@tcp:101:bash.0 Request processed in 248us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587850.472660:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 193 00000100:00100000:2.0:1788587850.476058:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587850.476166:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026097408 00000100:00100000:3.0:1788587850.476174:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026097408 00000100:00100000:3.0:1788587850.476242:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 58 00000100:00100000:3.0:1788587850.476252:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:11033:x1875470026097408:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:3.0:1788587850.476267:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587850.476285:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8f98 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1411 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587850.476309:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9baf45, atime: 0x6a9baf44, ctime: 0x6a9baf45, blocks: 0xb 00010000:00010000:3.0:1788587850.476340:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=297s v=(0 0) 00010000:00010000:3.0:1788587850.476345:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587850.476352:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8f98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1411 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.476367:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8f98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1411 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.476378:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031a00, rc 0) 00000100:00100000:3.0:1788587850.476432:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:11033:x1875470026097408:12345-192.168.206.33@tcp:101:bash.0 Request processed in 181us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587850.476439:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 58 00000100:00080000:2.0:1788587850.476582:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587850.483001:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587850.483057:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026097536 00000100:00100000:2.0:1788587850.483067:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026097536 00002000:00010000:2.0:1788587850.483110:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1788587850.483114:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4b4f84000 with x1875470026097536 ext(0->18446744073709551615) 00002000:00010000:2.0:1788587850.483126:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f4b4f84000. 00000100:00100000:2.0:1788587850.483197:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:2.0:1788587850.483206:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026097536:12345-192.168.206.33@tcp:10:bash.0 00002000:00010000:2.0:1788587850.483483:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788587850.483487:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788587845 -> 1788587849 00002000:00010000:2.0:1788587850.483490:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788587844 -> 1788587844 00002000:00010000:2.0:1788587850.483492:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788587845 -> 1788587849 00002000:00010000:2.0:1788587850.483494:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788587850.483565:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2344:x1875470026097536:12345-192.168.206.33@tcp:10:bash.0 Request processed in 359us (571us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788587850.483589:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 5 00002000:00010000:2.0:1788587850.483592:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1788587850.483595:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4b4f84000 with x1875470026097536 ext(0->18446744073709551615) 00002000:00010000:2.0:1788587850.483600:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f4b4f84000. 00000100:00100000:1.0:1788587850.626254:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587850.626359:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026097664 00000100:00100000:3.0:1788587850.626368:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026097664 00000100:00100000:3.0:1788587850.626422:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 194 00000100:00100000:3.0:1788587850.626432:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11521:x1875470026097664:12345-192.168.206.33@tcp:34:lfs.0 00010000:00010000:3.0:1788587850.626524:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8f9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.626542:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8f9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.626554:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8f9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.626568:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8fa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.626575:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.626596:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627126:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8fad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627136:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627144:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587850.627178:0:8471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627188:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8f9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627195:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8f9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627202:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8f9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627207:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587850.627211:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8f9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627218:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8f9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627228:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:3.0:1788587850.627236:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587850.627241:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8f9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627248:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca8f9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627259:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627265:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8fa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627271:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627275:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587850.627278:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627284:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627290:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f484d44000) 00010000:00010000:3.0:1788587850.627292:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587850.627295:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8fa6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627300:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca8fa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627314:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627324:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8fad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627330:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627335:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587850.627337:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627343:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8fad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627350:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f493d34800) 00010000:00010000:3.0:1788587850.627352:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587850.627355:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8fad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.627360:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca8fad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587850.627430:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11521:x1875470026097664:12345-192.168.206.33@tcp:34:lfs.0 Request processed in 998us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587850.627438:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 194 00000100:00100000:2.0:1788587850.698552:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587850.698902:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587850.698919:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043912576:0@lo:400:kworker.0 00000100:00100000:1.0:1788587850.698968:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587850.699025:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043912576 00000100:00100000:2.0:1788587850.699032:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043912576 00000100:00100000:2.0:1788587850.699090:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788587850.699098:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043912576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587850.699113:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587850.699121:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38385b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043912704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587850.699141:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3305:x1875470043912576:12345-0@lo:400:kworker.0 Request processed in 44us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587850.699148:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587850.699155:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788587850.699172:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043912704 00000100:00100000:3.0:1788587850.699175:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043912704 00000100:00080000:2.0:1788587850.699201:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587850.699206:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788587850.699269:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026097920 00000100:00100000:0.0:1788587850.699274:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026097920 00000100:00100000:0.0:1788587850.699305:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 195 00000100:00100000:0.0:1788587850.699312:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11524:x1875470026097920:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587850.699326:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587850.699344:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8fb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1418 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699412:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8fbb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699426:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8fbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699438:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8fbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699460:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8fc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699468:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699474:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699720:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8fc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699730:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699736:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587850.699746:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788587850.699826:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8fbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699833:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8fbb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699862:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8fbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699868:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587850.699872:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8fbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699890:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8fbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699917:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:0.0:1788587850.699920:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587850.699925:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8fbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699932:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca8fbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699944:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699949:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8fc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699955:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699959:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587850.699962:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699968:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8fc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699974:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f493d34000) 00010000:00010000:0.0:1788587850.699976:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587850.699979:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8fc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.699993:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca8fc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587850.700094:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38385b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043912704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587850.700124:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587850.700172:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38385b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043912704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 948us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587850.700495:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043912576:0@lo:400:kworker.0 00000100:00100000:1.0:1788587850.700569:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043912832:0@lo:400:kworker.0 00000100:00100000:1.0:1788587850.700597:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587850.700643:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043912832 00000100:00100000:1.0:1788587850.700648:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043912832 00000100:00100000:1.0:1788587850.700678:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788587850.700685:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043912832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587850.700717:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043912832:12345-0@lo:400:kworker.0 Request processed in 32us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587850.700723:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788587850.700752:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043912832:0@lo:400:kworker.0 00000100:00100000:1.0:1788587850.700777:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043912960:0@lo:400:kworker.0 00000100:00100000:1.0:1788587850.700798:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587850.700822:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043912960 00000100:00100000:1.0:1788587850.700825:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043912960 00000100:00100000:1.0:1788587850.700864:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788587850.700869:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043912960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587850.700897:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043912960:12345-0@lo:400:kworker.0 Request processed in 28us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587850.700913:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1788587850.700929:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587850.700944:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043912960:0@lo:400:kworker.0 00000100:00100000:1.0:1788587850.700968:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587850.700974:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043913088:0@lo:400:kworker.0 00000100:00100000:1.0:1788587850.701109:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587850.701151:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043913216:0@lo:400:kworker.0 00000100:00100000:1.0:1788587850.701172:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587850.701194:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043913216 00000100:00100000:1.0:1788587850.701197:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043913216 00000100:00100000:1.0:1788587850.701221:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788587850.701227:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043913216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587850.701255:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043913216:12345-0@lo:400:kworker.0 Request processed in 28us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587850.701260:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1788587850.701271:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587850.701285:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043913216:0@lo:400:kworker.0 00000100:00100000:1.0:1788587850.701323:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043913088 00000100:00100000:1.0:1788587850.701327:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043913088 00000100:00100000:1.0:1788587850.701347:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788587850.701352:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043913088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587850.701381:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043913088:12345-0@lo:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587850.701386:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788587850.701405:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043913088:0@lo:400:kworker.0 00000100:00100000:1.0:1788587850.701462:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38385b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043912704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788587850.701600:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca8fb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1418 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.701615:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1418 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.703220:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f493d34800) 00010000:00010000:0.0:1788587850.703229:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788587850.703236:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b400, rc 0) 00000100:00100000:0.0:1788587850.703296:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+34:11524:x1875470026097920:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 3981us (4750us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788587850.703304:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 195 00000100:00100000:3.0:1788587850.706984:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788587850.710787:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587850.710916:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026098048 00000100:00100000:1.0:1788587850.710925:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026098048 00000100:00100000:1.0:1788587850.710972:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 196 00000100:00100000:1.0:1788587850.710981:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+34:11524:x1875470026098048:12345-192.168.206.33@tcp:54:lfs.0 00010000:00010000:1.0:1788587850.711042:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.711072:0:7276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1403 expref: 34 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.711082:0:7276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.711116:0:7276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1403 expref: 34 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.711130:0:7276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1403 expref: 34 pid: 8471 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587850.711144:0:7276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5337480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7276:1875470043913344:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587850.711221:0:7276:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874000 going to sleep for 11 seconds 00000100:00100000:2.0:1788587850.716445:0:7276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5337480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7276:1875470043913344:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587850.716472:0:7276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587850.717757:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587850.717883:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026098304 00000100:00100000:1.0:1788587850.717891:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026098304 00000100:00100000:1.0:1788587850.717941:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 52 00000100:00100000:1.0:1788587850.717951:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+35:5584:x1875470026098304:12345-192.168.206.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788587850.718257:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:5584:x1875470026098304:12345-192.168.206.33@tcp:35:ldlm_bl.0 Request processed in 306us (505us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788587850.718279:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 52 00000100:00100000:1.0:1788587850.724219:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587850.724458:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026098432 00000100:00100000:3.0:1788587850.724466:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026098432 00010000:00010000:3.0:1788587850.724512:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1403 expref: 36 pid: 8471 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587850.724556:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 75 00000100:00100000:3.0:1788587850.724566:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:2345:x1875470026098432:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587850.724580:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587850.724587:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1403 expref: 36 pid: 8471 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.724600:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1403 expref: 36 pid: 8471 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.724621:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca8f7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1403 expref: 36 pid: 8471 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.724637:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f493d34800) 00010000:00010000:3.0:1788587850.724642:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.724652:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.724670:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.724703:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587850.725482:0:7276:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.725493:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.725535:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.725543:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.725563:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.725568:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587850.725572:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.725578:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.725589:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f493d34800) 00010000:00010000:2.0:1788587850.725592:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587850.725595:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587850.725601:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca8fd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587850.725681:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+35:11524:x1875470026098048:12345-192.168.206.33@tcp:54:lfs.0 Request processed in 14699us (14900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587850.725689:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 196 00000100:00100000:3.0:1788587850.725856:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+34:2345:x1875470026098432:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 1277us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587850.725864:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 75 00000100:00100000:3.0:1788587850.730469:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587850.730618:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026098688 00000100:00100000:0.0:1788587850.730626:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026098688 00000100:00100000:0.0:1788587850.730673:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 53 00000100:00100000:0.0:1788587850.730683:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+34:11524:x1875470026098688:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:0.0:1788587850.730945:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+35:11524:x1875470026098688:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 262us (483us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788587850.730952:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 53 00000100:00100000:0.0:1788587850.850898:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587850.850994:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026098944 00000100:00100000:1.0:1788587850.851004:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026098944 00000100:00100000:1.0:1788587850.851064:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 197 00000100:00100000:1.0:1788587850.851074:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+35:11535:x1875470026098944:12345-192.168.206.33@tcp:101:cat.0 00010000:00010000:1.0:1788587850.851097:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587850.851118:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8fde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db141f expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.851186:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca8fe5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.851200:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca8fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.851213:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca8fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.851228:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8fec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.851235:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.851241:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.851945:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8ff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.851964:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.851973:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587850.851984:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788587850.852071:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca8fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852079:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca8fe5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852086:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca8fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852091:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587850.852095:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca8fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852102:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca8fe5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852114:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:1.0:1788587850.852117:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587850.852121:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca8fe5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852127:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca8fe5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852140:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852152:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8fec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852158:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852162:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587850.852165:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852171:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8fec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852179:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f48fa37900) 00010000:00010000:1.0:1788587850.852182:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587850.852184:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8fec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852190:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca8fec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852233:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca8fde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db141f expref: 38 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852247:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db141f expref: 37 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.852254:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f493d34800) 00010000:00010000:1.0:1788587850.852257:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587850.852265:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1600, rc 0) 00000100:00100000:1.0:1788587850.852454:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:11535:x1875470026098944:12345-192.168.206.33@tcp:101:cat.0 Request processed in 1381us (1565us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788587850.852463:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 197 00000100:00100000:3.0:1788587850.866024:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587850.867251:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026099200 00000100:00100000:0.0:1788587850.867278:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026099200 00000100:00100000:0.0:1788587850.867400:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 54 00000100:00100000:0.0:1788587850.867412:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:11535:x1875470026099200:12345-192.168.206.33@tcp:35:cat.0 00000100:00100000:0.0:1788587850.867654:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+38:11535:x1875470026099200:12345-192.168.206.33@tcp:35:cat.0 Request processed in 243us (1637us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788587850.867662:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 54 00000100:00100000:2.0:1788587850.912598:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587850.912717:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026099456 00000100:00100000:0.0:1788587850.912727:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026099456 00000100:00100000:0.0:1788587850.912976:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 198 00000100:00100000:0.0:1788587850.912987:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+38:11536:x1875470026099456:12345-192.168.206.33@tcp:36:rm.0 00010000:00010000:0.0:1788587850.913051:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788587850.913077:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca8ff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db141f expref: 38 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.913100:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca8fc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1418 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.913112:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c200/0xa13e120d54ca8f91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db140a expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.913121:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f493d34800) 00010000:00010000:0.0:1788587850.913131:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587850.913292:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca9001 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.913308:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca9001 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.913345:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca9001 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.913361:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca9008 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.913368:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca9008 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.913389:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca9008 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.913635:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca900f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.913643:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca900f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.913651:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca900f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587850.915538:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1788587850.915549:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 298170706359ns, next at 299170703764ns, rc = 0 00010000:00010000:0.0:1788587850.915615:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9016 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915630:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9016 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915640:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9016 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915665:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9016 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915671:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9016 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915677:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9016 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915753:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587850.915775:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca900f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915781:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca900f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915787:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca900f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915792:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587850.915805:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca900f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915812:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca900f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915824:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f493d34200) 00010000:00010000:0.0:1788587850.915827:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788587850.915831:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca900f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915893:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca900f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915912:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca9001 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915918:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca9001 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915924:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca9001 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915929:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587850.915932:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca9001 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915937:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca9001 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915946:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:0.0:1788587850.915949:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587850.915952:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca9001 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587850.915957:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca9001 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587850.915966:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3ddead6 reply state 00000000fb5ec68b transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca9008 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587850.915974:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587850.916300:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+37:11536:x1875470026099456:12345-192.168.206.33@tcp:36:rm.0 Request processed in 3311us (3707us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788587850.916309:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 198 00010000:00010000:3.0:1788587850.920253:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca9008 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.920270:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca9008 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.920278:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca9008 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.920284:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587850.920289:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca9008 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.920296:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca9008 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.920324:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f493d34000) 00010000:00010000:3.0:1788587850.920327:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587850.920332:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca9008 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587850.920356:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca9008 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.925984:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587850.926362:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9016 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.926633:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a400 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587850.926639:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9016 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.926649:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9016 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.926666:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88f493d34200) 00010000:00010000:1.0:1788587850.926669:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788587850.926674:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9016 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.926680:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9016 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587850.926706:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587850.926708:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587850.926710:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587851.005314:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587851.005412:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026099712 00000100:00100000:1.0:1788587851.005423:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026099712 00000100:00100000:1.0:1788587851.005483:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 199 00000100:00100000:1.0:1788587851.005493:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+36:11542:x1875470026099712:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:1.0:1788587851.005525:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587851.005557:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca901d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1426 expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.005666:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9024 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.005680:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9024 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.005691:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9024 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.005705:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca902b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.005712:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca902b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.005717:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca902b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788587851.006357:0:7276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788587851.006529:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9032 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.006541:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.006549:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.006579:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9024 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.006596:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9024 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.006603:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9024 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.006609:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587851.006613:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9024 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.006620:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9024 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.006632:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:1.0:1788587851.006636:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587851.006640:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9024 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.006647:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9024 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587851.006660:0:7276:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000401ad398 reply state 000000009687d1a7 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca902b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587851.006668:0:7276:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788587851.006694:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca901d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1426 expref: 39 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.006708:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9032 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1426 expref: 38 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.006727:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:1.0:1788587851.006729:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587851.006732:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1200, rc 0) 00000100:00100000:1.0:1788587851.006802:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+39:11542:x1875470026099712:12345-192.168.206.33@tcp:101:bash.0 Request processed in 1310us (1496us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788587851.006810:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 199 00010000:00010000:1.0:1788587851.009422:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca902b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.009438:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca902b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.009445:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca902b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.009450:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587851.009454:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca902b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.009461:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca902b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.009477:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f48fa37900) 00010000:00010000:1.0:1788587851.009480:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587851.009484:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca902b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.009490:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca902b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587851.010640:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587851.010973:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026099840 00000100:00100000:3.0:1788587851.010983:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026099840 00000100:00100000:3.0:1788587851.011061:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 59 00000100:00100000:3.0:1788587851.011070:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2347:x1875470026099840:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:3.0:1788587851.011085:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587851.011102:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca9040 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db142d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788587851.011222:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1788587851.011388:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788587851.011406:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=298s v=(0 0) 00010000:00010000:3.0:1788587851.011410:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587851.011419:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca9040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db142d expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.011437:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca9040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db142d expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.011450:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030800, rc 0) 00000100:00100000:3.0:1788587851.011514:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2347:x1875470026099840:12345-192.168.206.33@tcp:101:bash.0 Request processed in 444us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587851.011521:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 59 00000100:00100000:3.0:1788587851.017890:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587851.018049:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026099968 00000100:00100000:1.0:1788587851.018059:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026099968 00000100:00100000:1.0:1788587851.018129:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 60 00000100:00100000:1.0:1788587851.018140:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:11542:x1875470026099968:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:1.0:1788587851.018157:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587851.018173:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1434 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.018202:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca9040 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db142d expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.018210:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587851.018214:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587851.018219:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.018251:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca9040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db142d expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.018264:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca9040 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db142d expref: 7 pid: 6694 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587851.018278:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5335c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1875470043913472:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587851.018369:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587851.027978:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5335c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1875470043913472:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587851.028014:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.028034:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0800, rc 0) 00000100:00100000:1.0:1788587851.028097:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:11542:x1875470026099968:12345-192.168.206.33@tcp:101:bash.0 Request processed in 9958us (10255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587851.028106:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 60 00000100:00100000:3.0:1788587851.028168:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587851.028492:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026100096 00000100:00100000:0.0:1788587851.028512:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026100096 00010000:00010000:0.0:1788587851.028542:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca9040 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db142d expref: 7 pid: 6694 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587851.028572:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 76 00000100:00100000:0.0:1788587851.028581:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2344:x1875470026100096:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587851.028594:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587851.028616:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca9040 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db142d expref: 7 pid: 6694 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.028629:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca9040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db142d expref: 7 pid: 6694 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.028650:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e94708/0xa13e120d54ca9040 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db142d expref: 7 pid: 6694 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.028665:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587851.028669:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587851.028677:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.028687:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.028726:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587851.028740:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4f85500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1875470043913600:192.168.206.33@tcp:105: 00000100:00100000:0.0:1788587851.028819:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4918ded80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587851.035957:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4f85500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1875470043913600:192.168.206.33@tcp:105: 00010000:00010000:0.0:1788587851.035981:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587851.036054:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2344:x1875470026100096:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 7472us (7886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587851.036065:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 76 00000100:00100000:1.0:1788587851.047160:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587851.047310:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026100352 00000100:00100000:3.0:1788587851.047330:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026100352 00000100:00100000:3.0:1788587851.047374:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 55 00000100:00100000:3.0:1788587851.047383:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+38:11542:x1875470026100352:12345-192.168.206.33@tcp:35:bash.0 00000100:00100000:3.0:1788587851.047703:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+39:11542:x1875470026100352:12345-192.168.206.33@tcp:35:bash.0 Request processed in 320us (563us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788587851.047712:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 55 00010000:00010000:1.0:1788587851.210288:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587851.210411:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587851.210675:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026100480 00000100:00100000:1.0:1788587851.210684:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026100480 00000100:00100000:1.0:1788587851.210773:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 200 00000100:00100000:1.0:1788587851.210784:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+39:11558:x1875470026100480:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587851.210804:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587851.210824:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca904e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db143b expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.210905:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9055 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.210920:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.210931:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587851.210982:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788587851.210986:0:8471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587851.211029:0:8471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.211054:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca904e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db143b expref: 41 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.211073:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9055 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db143b expref: 40 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.211082:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:1.0:1788587851.211084:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587851.211088:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0600, rc 0) 00000100:00100000:1.0:1788587851.211152:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+40:11558:x1875470026100480:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 370us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587851.211159:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 200 00000100:00100000:3.0:1788587851.217352:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587851.221301:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026100736 00000100:00100000:2.0:1788587851.221316:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026100736 00000100:00100000:2.0:1788587851.221387:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 201 00000100:00100000:2.0:1788587851.221398:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38385b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+40:11558:x1875470026100736:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:2.0:1788587851.221430:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587851.221451:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca905c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1442 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.221556:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca9063 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.221571:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca9063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.221582:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca9063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587851.221594:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788587851.221710:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca905c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1442 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.221728:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca9063 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1442 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.221736:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:2.0:1788587851.221740:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587851.221743:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d400, rc 0) 00000100:00100000:2.0:1788587851.221810:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38385b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+42:11558:x1875470026100736:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 414us (4467us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788587851.221817:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 201 00000100:00100000:0.0:1788587851.224706:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587851.225803:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026100992 00000100:00100000:2.0:1788587851.225815:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026100992 00000100:00100000:3.0:1788587851.226456:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 202 00000100:00100000:3.0:1788587851.226468:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+42:11558:x1875470026100992:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587851.226490:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587851.226521:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca9071 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1449 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.226616:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca9078 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.226631:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca9078 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.226642:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca9078 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587851.226654:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788587851.226765:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca9071 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1449 expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.226782:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca9078 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1449 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.226803:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:3.0:1788587851.226806:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788587851.226809:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030200, rc 0) 00000100:00100000:3.0:1788587851.226906:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+44:11558:x1875470026100992:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 440us (2207us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788587851.226913:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 202 00000100:00100000:2.0:1788587851.238581:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587851.238677:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587851.238703:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587851.238731:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587851.238749:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587851.238770:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587851.238796:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026101248 00000100:00100000:2.0:1788587851.238804:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026101248 00000100:00100000:2.0:1788587851.238858:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026101632 00000100:00100000:2.0:1788587851.238861:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026101632 00000100:00100000:1.0:1788587851.239278:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026101376 00000100:00100000:1.0:1788587851.239282:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026101376 00000100:00100000:1.0:1788587851.239331:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 289 00000100:00100000:1.0:1788587851.239342:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2347:x1875470026101376:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587851.239426:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2347:x1875470026101376:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 86us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587851.239434:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 289 00000100:00100000:1.0:1788587851.239472:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026101504 00000100:00100000:1.0:1788587851.239476:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026101504 00000100:00080000:1.0:1788587851.239497:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587851.239540:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 139 00000100:00100000:1.0:1788587851.239547:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026101504:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587851.239576:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b66627bb-533c-4cf5-aca4-320057d76d08+5:2346:x1875470026101504:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 30us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587851.239590:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 139 00000100:00100000:2.0:1788587851.239779:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 61 00000100:00100000:2.0:1788587851.239787:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2345:x1875470026101248:12345-192.168.206.33@tcp:16:kworker.0 00000100:00100000:2.0:1788587851.239891:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2345:x1875470026101248:12345-192.168.206.33@tcp:16:kworker.0 Request processed in 104us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587851.239897:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 61 00000100:00100000:2.0:1788587851.239913:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 62 00000100:00100000:2.0:1788587851.239920:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+6:2345:x1875470026101632:12345-192.168.206.33@tcp:1:lfs.0 00000100:00100000:0.0:1788587851.240250:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026101760 00000100:00100000:0.0:1788587851.240255:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026101760 00000100:00100000:0.0:1788587851.240291:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 15 00000100:00100000:0.0:1788587851.240297:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+44:2344:x1875470026101760:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587851.240319:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587851.240341:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca9063 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1442 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.240360:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:0.0:1788587851.240365:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587851.240386:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+43:2344:x1875470026101760:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 89us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587851.240392:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 15 00010000:00010000:2.0:1788587851.241252:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b81faca1/0xa13e120d54ca9086 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.241275:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.241283:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587851.241287:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587851.241292:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b81faca1/0xa13e120d54ca9086 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.241468:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.241482:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 6 pid: 6695 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587851.241496:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf5e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6694:1875470043913728:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587851.244804:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4f7bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587851.245462:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026101120 00000100:00100000:3.0:1788587851.245471:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026101120 00002000:00100000:3.0:1788587851.245528:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff88f3838ab800 x1875470026101120/t0(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:412/0 lens 504/0 e 0 to 0 dl 1788587862 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587851.245539:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f3838ab800 with x1875470026101120 ext(0->8) 00010000:00010000:3.0:1788587851.245548:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 7 pid: 6695 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.245563:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 7 pid: 6695 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587851.245570:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88f3838ab800 00000100:00100000:3.0:1788587851.245595:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 3 00000100:00100000:3.0:1788587851.245604:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2345:x1875470026101120:12345-192.168.206.33@tcp:4:bash.0 00000100:00100000:3.0:1788587851.246122:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2345:x1875470026101120:12345-192.168.206.33@tcp:4:bash.0 Request processed in 516us (7549us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788587851.246130:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 3 00002000:00100000:3.0:1788587851.246137:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff88f3838ab800 x1875470026101120/t4294967308(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:412/0 lens 504/448 e 0 to 0 dl 1788587862 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587851.246151:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f3838ab800 with x1875470026101120 ext(0->8) 00010000:00010000:3.0:1788587851.246157:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 9 pid: 6695 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.246167:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 9 pid: 6695 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587851.246174:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88f3838ab800 00000100:00100000:0.0:1788587851.259401:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587851.259765:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf5e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6694:1875470043913728:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587851.259794:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b81faca1/0xa13e120d54ca9086 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587851.264219:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026101888 00000100:00100000:3.0:1788587851.264233:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026101888 00010000:00010000:3.0:1788587851.264276:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 9 pid: 6695 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587851.264411:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 77 00000100:00100000:0.0:1788587851.264423:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2346:x1875470026101888:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587851.264439:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788587851.264457:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788587851.264460:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788587849 00002000:00010000:0.0:1788587851.264462:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788587849 00010000:00010000:0.0:1788587851.264469:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 9 pid: 6695 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.264483:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 9 pid: 6695 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.264515:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caf020a9/0xa13e120d54ca9047 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1434 expref: 9 pid: 6695 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.264531:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587851.264535:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587851.264541:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b81faca1/0xa13e120d54ca9086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.264550:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b81faca1/0xa13e120d54ca9086 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.264590:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587851.264645:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2346:x1875470026101888:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 225us (5254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587851.264667:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 77 00010000:00010000:1.0:1788587851.265190:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b81faca1/0xa13e120d54ca9086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.265202:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b81faca1/0xa13e120d54ca9086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.265225:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b81faca1/0xa13e120d54ca9086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.265234:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b81faca1/0xa13e120d54ca9086 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.265242:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b81faca1/0xa13e120d54ca9086 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.265249:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159cc00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587851.265253:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81faca1/0xa13e120d54ca9086 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.265262:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81faca1/0xa13e120d54ca9086 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.265275:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b81faca1/0xa13e120d54ca9086 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.265297:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b81faca1/0xa13e120d54ca9086 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587851.265370:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2345:x1875470026101632:12345-192.168.206.33@tcp:1:lfs.0 Request processed in 25449us (26619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587851.265378:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 62 00000100:00100000:0.0:1788587851.271326:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587851.271481:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026102144 00000100:00100000:3.0:1788587851.271491:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026102144 00000100:00100000:3.0:1788587851.271548:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 56 00000100:00100000:3.0:1788587851.271556:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+43:11558:x1875470026102144:12345-192.168.206.33@tcp:35:lfs.0 00000004:00010000:3.0:1788587851.271611:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca9078 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1449 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788587851.271830:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788587851.271904:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788587851.272691:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788587851.272743:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.272759:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9032 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1426 expref: 47 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.272776:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.272806:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9032 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1426 expref: 47 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.272819:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9032 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1426 expref: 47 pid: 7276 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587851.272833:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab6e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875470043913856:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587851.275077:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491ee76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587851.278170:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587851.278303:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab6e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875470043913856:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587851.278328:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587851.280265:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026102272 00000100:00100000:1.0:1788587851.280276:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026102272 00010000:00010000:0.0:1788587851.282627:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9032 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1426 expref: 48 pid: 7276 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587851.282742:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 78 00000100:00100000:0.0:1788587851.282754:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+48:2344:x1875470026102272:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587851.282770:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587851.282777:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9032 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1426 expref: 48 pid: 7276 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.282790:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9032 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1426 expref: 48 pid: 7276 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.282826:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9032 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1426 expref: 48 pid: 7276 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.282859:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:0.0:1788587851.282865:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.282874:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.282882:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.282932:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587851.282987:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+47:2344:x1875470026102272:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 235us (4827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587851.283006:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 78 00010000:00010000:2.0:1788587851.283084:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.283094:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587851.283205:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788587851.283389:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788587851.283510:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf5e4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875470043913984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788587851.283581:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587851.283628:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4f7b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587851.284779:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043913984 00000100:00100000:0.0:1788587851.284788:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043913984 00000100:00100000:0.0:1788587851.284867:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587851.284875:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875470043913984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788587851.284959:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875470043913984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587851.284966:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788587851.286177:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587851.286225:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf5e4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875470043913984:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788587851.291254:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788587851.291346:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf742d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875470043914112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788587851.291407:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587851.291441:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4f7bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587851.292208:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043914112 00000100:00100000:0.0:1788587851.292217:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043914112 00000100:00100000:0.0:1788587851.292270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788587851.292279:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875470043914112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788587851.292509:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875470043914112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 222us (1091us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788587851.292517:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587851.293008:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf742d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875470043914112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788587851.293082:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1788587851.293126:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.293136:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.293144:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.293150:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587851.293154:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.293162:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.293177:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:2.0:1788587851.293180:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788587851.293193:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.293201:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca908d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587851.293390:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788587851.293478:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788587851.293488:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 298548645259ns, next at 299548643268ns, rc = 0 00000001:00080000:2.0:1788587851.293494:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788587851.293538:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:2.0:1788587851.293541:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788587851.293548:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca9078 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1449 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587851.293650:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+50:11558:x1875470026102144:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 22094us (22331us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788587851.293659:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 56 00000020:00080000:2.0:1788587851.293663:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788587851.297781:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587851.297906:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026102400 00000100:00100000:2.0:1788587851.297915:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026102400 00000100:00100000:2.0:1788587851.297962:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 203 00000100:00100000:2.0:1788587851.298169:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+50:11558:x1875470026102400:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:2.0:1788587851.298194:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587851.298217:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca9094 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1450 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.298276:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca9094 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1450 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.298310:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca9094 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1450 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.298534:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:2.0:1788587851.298538:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587851.298542:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d800, rc 0) 00000100:00100000:2.0:1788587851.298653:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+51:11558:x1875470026102400:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 681us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587851.298660:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 203 00000100:00100000:0.0:1788587851.311940:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587851.312204:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026102656 00000100:00100000:1.0:1788587851.312215:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026102656 00000100:00100000:1.0:1788587851.312321:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 57 00000100:00100000:1.0:1788587851.312333:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+51:11558:x1875470026102656:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:1.0:1788587851.312582:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+52:11558:x1875470026102656:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 250us (650us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788587851.312590:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 57 00000100:00100000:1.0:1788587851.423168:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587851.423276:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026102784 00000100:00100000:3.0:1788587851.423286:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026102784 00000100:00100000:3.0:1788587851.423376:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 204 00000100:00100000:3.0:1788587851.423386:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+52:11568:x1875470026102784:12345-192.168.206.33@tcp:34:lfs.0 00010000:00010000:3.0:1788587851.423466:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca909b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423482:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca909b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423495:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca909b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423520:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423528:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423553:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423635:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca90a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423644:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca90a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423651:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca90a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587851.423689:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca90a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423701:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca909b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423707:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca909b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423712:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca909b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423717:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587851.423722:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca909b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423744:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca909b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423760:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:3.0:1788587851.423768:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587851.423773:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca909b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423780:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca909b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423794:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423800:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423806:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423811:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587851.423813:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423820:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423828:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f484d44700) 00010000:00010000:3.0:1788587851.423830:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587851.423838:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423890:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423908:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca90a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423921:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca90a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423927:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca90a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423932:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587851.423935:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca90a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423942:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca90a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423950:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:3.0:1788587851.423953:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587851.423956:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca90a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.423961:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca90a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587851.424038:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+52:11568:x1875470026102784:12345-192.168.206.33@tcp:34:lfs.0 Request processed in 653us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587851.424047:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 204 00000100:00100000:0.0:1788587851.470370:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587851.470521:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026103040 00000100:00100000:1.0:1788587851.470533:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026103040 00000100:00100000:1.0:1788587851.470590:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 205 00000100:00100000:1.0:1788587851.470601:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+52:11571:x1875470026103040:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587851.470620:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587851.470641:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca90b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1457 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.470704:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.470837:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.470890:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.470924:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca90be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.470933:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca90be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.470940:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca90be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471066:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca90c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471075:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca90c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471082:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca90c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587851.471091:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788587851.471184:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471192:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471199:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471211:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587851.471216:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471223:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471235:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:1.0:1788587851.471239:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587851.471243:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471250:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471264:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca90be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471270:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca90be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471275:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca90be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471279:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587851.471282:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca90be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471287:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca90be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.471303:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f48fa37900) 00010000:00010000:1.0:1788587851.471306:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587851.472146:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca90be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.472158:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca90be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.472212:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca90b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1457 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.472226:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca90c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1457 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.472234:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587851.472237:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587851.472240:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1c00, rc 0) 00000100:00100000:1.0:1788587851.472390:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:11571:x1875470026103040:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 1712us (1949us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788587851.472398:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 205 00000100:00100000:1.0:1788587851.479712:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587851.479871:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026103168 00000100:00100000:2.0:1788587851.479879:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026103168 00000100:00100000:2.0:1788587851.479925:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 206 00000100:00100000:2.0:1788587851.479933:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:11571:x1875470026103168:12345-192.168.206.33@tcp:54:lfs.0 00010000:00010000:2.0:1788587851.479995:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca90d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.480012:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca90d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.480023:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca90d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.480046:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca90d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.480053:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca90d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.480074:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca90d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.480080:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159de00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587851.480084:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca90d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.480092:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca90d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.480103:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:2.0:1788587851.480106:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587851.480110:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca90d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.480117:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159de00/0xa13e120d54ca90d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587851.480172:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:11571:x1875470026103168:12345-192.168.206.33@tcp:54:lfs.0 Request processed in 239us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587851.480179:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 206 00000100:00100000:2.0:1788587851.489177:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587851.490702:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026103424 00000100:00100000:0.0:1788587851.490715:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026103424 00000100:00100000:0.0:1788587851.490773:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 58 00000100:00100000:0.0:1788587851.490783:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+54:11571:x1875470026103424:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:0.0:1788587851.491020:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:11571:x1875470026103424:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 237us (1852us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788587851.491042:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 58 00000040:00080000:2.0:1788587851.530423:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587851.530432:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587851.530593:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788587851.530600:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788587851.574448:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587851.574612:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026103680 00000100:00100000:3.0:1788587851.574623:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026103680 00000100:00100000:3.0:1788587851.574683:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 207 00000100:00100000:3.0:1788587851.574693:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f48366e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:11581:x1875470026103680:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:3.0:1788587851.574715:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587851.574742:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788587851.574768:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0600/0xa13e120d54ca9055 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db143b expref: 55 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.574788:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:3.0:1788587851.574794:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587851.574807:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca90da lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db145e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.574951:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.574966:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca90c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1457 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.574974:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.575189:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca90c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1457 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.575204:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca90c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1457 expref: 55 pid: 5841 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587851.575218:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043914240:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587851.575307:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491ee7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587851.582320:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043914240:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587851.582349:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587851.587192:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587851.587572:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026103808 00000100:00100000:2.0:1788587851.587582:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026103808 00010000:00010000:2.0:1788587851.587623:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca90c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1457 expref: 56 pid: 5841 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587851.587683:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 79 00000100:00100000:2.0:1788587851.587693:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+56:2344:x1875470026103808:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587851.587707:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587851.587714:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca90c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1457 expref: 56 pid: 5841 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.587727:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca90c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1457 expref: 56 pid: 5841 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.587748:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1c00/0xa13e120d54ca90c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1457 expref: 56 pid: 5841 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.587766:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:2.0:1788587851.587771:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.587780:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.587787:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587851.587822:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587851.588224:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:2344:x1875470026103808:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 530us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587851.588234:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 79 00010000:00010000:1.0:1788587851.588638:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.588648:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587851.588670:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788587851.588820:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca90da lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db145e expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.588837:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db145e expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.589333:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587851.589336:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788587851.589340:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030600, rc 0) 00000100:00100000:1.0:1788587851.589396:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f48366e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:11581:x1875470026103680:12345-192.168.206.33@tcp:101:bash.0 Request processed in 14702us (14956us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788587851.589403:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 207 00000100:00100000:0.0:1788587851.597284:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587851.597370:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026104064 00000100:00100000:1.0:1788587851.597381:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026104064 00000100:00100000:1.0:1788587851.597561:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 208 00000100:00100000:1.0:1788587851.597572:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4867b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+55:11581:x1875470026104064:12345-192.168.206.33@tcp:36:bash.0 00010000:00010000:1.0:1788587851.597869:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca90ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.597886:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca90ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.597898:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca90ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587851.597968:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1788587851.597993:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093dfcb4b reply state 000000008bfc9cde transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca90ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587851.598002:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587851.598121:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4867b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+58:11581:x1875470026104064:12345-192.168.206.33@tcp:36:bash.0 Request processed in 550us (845us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788587851.598138:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 208 00000020:00080000:1.0:1788587851.598143:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788587851.603285:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca90ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.603303:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca90ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.603679:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca90ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.603686:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587851.603691:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca90ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.603698:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca90ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.603714:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:3.0:1788587851.603717:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587851.603722:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca90ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.603728:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1800/0xa13e120d54ca90ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587851.607212:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587851.608385:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026104192 00000100:00100000:1.0:1788587851.608397:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026104192 00000100:00100000:1.0:1788587851.608544:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 209 00000100:00100000:1.0:1788587851.608554:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+57:11581:x1875470026104192:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:1.0:1788587851.608575:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587851.608594:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca90f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1465 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.608671:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.608685:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db145e expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.608693:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.608723:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db145e expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.608736:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db145e expref: 58 pid: 5843 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587851.608748:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5337480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8471:1875470043914368:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587851.608827:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587851.613062:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587851.613633:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026104320 00000100:00100000:0.0:1788587851.613643:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026104320 00010000:00010000:0.0:1788587851.613685:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db145e expref: 59 pid: 5843 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587851.613733:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 80 00000100:00100000:0.0:1788587851.613743:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf740a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:2344:x1875470026104320:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587851.613757:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587851.613763:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db145e expref: 59 pid: 5843 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.613777:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db145e expref: 59 pid: 5843 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.613799:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:0.0:1788587851.613804:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.613814:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.613822:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.613864:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587851.613917:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf740a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:2344:x1875470026104320:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 175us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587851.613923:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 80 00010000:00010000:1.0:1788587851.614950:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca90e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db145e expref: 58 pid: 5843 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587851.614972:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5337480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8471:1875470043914368:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587851.615004:0:8471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.615014:0:8471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.615020:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587851.615076:0:8471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788587851.615081:0:8471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587851.615101:0:8471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.615131:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca90f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1465 expref: 58 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.615145:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1465 expref: 57 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.615154:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587851.615157:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587851.615160:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0e00, rc 0) 00000100:00100000:1.0:1788587851.615591:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+57:11581:x1875470026104192:12345-192.168.206.33@tcp:101:bash.0 Request processed in 7037us (8388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587851.615598:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 209 00000100:00100000:2.0:1788587851.618411:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587851.618586:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026104576 00000100:00100000:3.0:1788587851.618596:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026104576 00000100:00100000:3.0:1788587851.618650:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 59 00000100:00100000:3.0:1788587851.618661:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+57:11581:x1875470026104576:12345-192.168.206.33@tcp:35:bash.0 00000100:00100000:3.0:1788587851.619251:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+58:11581:x1875470026104576:12345-192.168.206.33@tcp:35:bash.0 Request processed in 590us (846us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788587851.619275:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 59 00000100:00100000:0.0:1788587851.707899:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587851.708347:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026104704 00000100:00100000:1.0:1788587851.708358:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026104704 00000100:00100000:1.0:1788587851.708426:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 210 00000100:00100000:1.0:1788587851.708435:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+58:11587:x1875470026104704:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587851.708458:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587851.708477:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9104 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db146c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.708546:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca910b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.708561:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca910b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.708573:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca910b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587851.708607:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788587851.708611:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587851.708626:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca910b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.708648:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9104 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db146c expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.708668:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca910b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db146c expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.708678:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:1.0:1788587851.708682:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587851.708700:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1e00, rc 0) 00000100:00100000:1.0:1788587851.708814:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:11587:x1875470026104704:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 380us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587851.708822:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 210 00000100:00100000:2.0:1788587851.714675:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587851.714770:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026104832 00000100:00100000:1.0:1788587851.714779:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026104832 00000100:00100000:1.0:1788587851.714912:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 211 00000100:00100000:1.0:1788587851.714922:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:11587:x1875470026104832:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587851.714941:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587851.714962:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9112 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1473 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715176:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9119 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715192:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715205:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715220:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9120 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715227:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715234:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715326:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca9127 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715345:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca9127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715353:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca9127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587851.715402:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788587851.715407:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587851.715423:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca9127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715435:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca9127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715443:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715450:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9119 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715457:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9119 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715463:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587851.715467:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9119 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715475:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9119 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715486:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:1.0:1788587851.715489:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587851.715512:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9119 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715519:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9119 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715533:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715539:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9120 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715545:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9120 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715551:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587851.715554:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9120 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715560:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9120 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715568:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f48fa37900) 00010000:00010000:1.0:1788587851.715570:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587851.715573:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9120 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715579:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9120 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715607:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9112 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1473 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715631:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca9127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1473 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.715638:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587851.715641:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587851.715643:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0a00, rc 0) 00000100:00100000:1.0:1788587851.715706:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+60:11587:x1875470026104832:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 786us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587851.715714:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 211 00000100:00100000:3.0:1788587851.719758:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587851.721762:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587851.721782:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026105216 00000100:00100000:3.0:1788587851.721791:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026105216 00000100:00100000:3.0:1788587851.721865:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 16 00000100:00100000:3.0:1788587851.721876:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d68c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+60:2344:x1875470026105216:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587851.721891:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587851.721913:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca9127 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1473 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.721930:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:3.0:1788587851.721935:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587851.721978:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d68c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:2344:x1875470026105216:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 105us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587851.721986:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 16 00000100:00100000:0.0:1788587851.725853:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026105088 00000100:00100000:0.0:1788587851.725866:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026105088 00000100:00100000:0.0:1788587851.725932:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 212 00000100:00100000:0.0:1788587851.725941:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:11587:x1875470026105088:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:0.0:1788587851.725960:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587851.725979:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca912e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db147a expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.726079:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.726094:0:7276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1465 expref: 60 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.726103:0:7276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.726133:0:7276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1465 expref: 60 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587851.726146:0:7276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1465 expref: 60 pid: 8471 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587851.726172:0:7276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7276:1875470043914496:192.168.206.33@tcp:104: 00000100:00100000:0.0:1788587851.726252:0:7276:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4918ded80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587851.729439:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587851.729463:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026105344 00000100:00100000:1.0:1788587851.729470:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026105344 00010000:00010000:1.0:1788587851.729514:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1465 expref: 61 pid: 8471 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587851.729544:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 81 00000100:00100000:1.0:1788587851.729553:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5337480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+61:2345:x1875470026105344:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587851.729567:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587851.729574:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1465 expref: 61 pid: 8471 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.729586:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1465 expref: 61 pid: 8471 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.729606:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587851.729622:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.729631:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.729638:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.729657:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587851.729700:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5337480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+61:2345:x1875470026105344:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 148us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587851.729707:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 81 00010000:00010000:1.0:1788587851.729753:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca90fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1465 expref: 60 pid: 8471 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587851.729768:0:7276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7276:1875470043914496:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587851.729787:0:7276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.729796:0:7276:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.729802:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587851.729817:0:7276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788587851.729971:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77bc00/0xa13e120d54ca912e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db147a expref: 61 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.729985:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db147a expref: 60 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.730011:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587851.730014:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788587851.730016:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a400, rc 0) 00000100:00100000:1.0:1788587851.730042:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+60:11587:x1875470026105088:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 4102us (10294us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788587851.730049:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 212 00000100:00100000:0.0:1788587851.737518:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587851.738614:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026105600 00000100:00100000:1.0:1788587851.738627:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026105600 00000100:00100000:1.0:1788587851.738691:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 17 00000100:00100000:1.0:1788587851.738701:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+60:11587:x1875470026105600:12345-192.168.206.33@tcp:103:lfs.0 00010000:00010000:1.0:1788587851.738716:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587851.738741:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d800/0xa13e120d54ca9094 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1450 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.738758:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587851.738763:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587851.738820:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:11587:x1875470026105600:12345-192.168.206.33@tcp:103:lfs.0 Request processed in 121us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587851.738828:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 17 00000100:00100000:2.0:1788587851.744923:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587851.745010:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026105728 00000100:00100000:3.0:1788587851.745019:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026105728 00000100:00100000:3.0:1788587851.745085:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 213 00000100:00100000:3.0:1788587851.745094:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:11587:x1875470026105728:12345-192.168.206.33@tcp:58:lfs.0 00010000:00010000:3.0:1788587851.745186:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9143 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.745202:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9143 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587851.745213:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9143 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587851.745403:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788587851.745691:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:11587:x1875470026105728:12345-192.168.206.33@tcp:58:lfs.0 Request processed in 597us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587851.745711:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 213 00000100:00100000:3.0:1788587851.751759:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587851.751955:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026105856 00000100:00100000:1.0:1788587851.751964:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026105856 00000100:00100000:1.0:1788587851.752017:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 214 00000100:00100000:1.0:1788587851.752026:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+59:11587:x1875470026105856:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587851.752044:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587851.752063:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca914a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1481 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.752130:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9143 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.752141:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca914a lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1481 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.752158:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9143 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.752170:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca914a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1481 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.752183:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587851.752187:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587851.752190:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca914a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1481 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587851.752198:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0e00, rc 0) 00000100:00100000:1.0:1788587851.752256:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+60:11587:x1875470026105856:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 231us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587851.752262:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 214 00000001:00080000:1.0:1788587851.769897:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788587851.769920:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1788587852.232239:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587852.552224:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587852.552232:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587852.552283:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788587852.552290:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788587852.552408:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf741f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875470043914624:192.168.206.33@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788587852.552551:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f493590600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587852.557716:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587852.557785:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026105984 00000100:00100000:1.0:1788587852.557794:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026105984 00000100:00100000:1.0:1788587852.557917:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 215 00000100:00100000:1.0:1788587852.557943:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+61:11588:x1875470026105984:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788587852.557975:0:8471:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788587852.558085:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+61:11588:x1875470026105984:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 Request processed in 145us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587852.558093:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 215 00000100:00080000:3.0:1788587852.558415:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587852.558507:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf741f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875470043914624:192.168.206.33@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587852.561453:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587852.561701:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026106112 00000100:00100000:2.0:1788587852.561709:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026106112 00000100:00100000:2.0:1788587852.561831:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 216 00000100:00100000:2.0:1788587852.561982:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+60:11588:x1875470026106112:12345-192.168.206.33@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788587852.565004:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9151 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565026:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9151 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565038:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9151 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565052:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca9158 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565060:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca9158 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565066:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca9158 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565102:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca915f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565111:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca915f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565117:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca915f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587852.565153:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788587852.565157:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587852.565169:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca915f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565179:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9151 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565186:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9151 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565192:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9151 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565197:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587852.565201:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9151 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565207:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9151 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565218:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44800) 00010000:00010000:2.0:1788587852.565226:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587852.565232:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9151 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565238:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9151 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565318:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca9158 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565333:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca9158 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565340:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca9158 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565345:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587852.565348:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca9158 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565354:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca9158 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565362:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff88f488834400) 00010000:00010000:2.0:1788587852.565365:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587852.565367:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca9158 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565373:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca9158 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565398:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca915f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565411:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca915f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565416:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca915f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565421:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587852.565424:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca915f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565430:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca915f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565439:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:2.0:1788587852.565441:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587852.565445:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca915f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.565450:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca915f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587852.565551:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+60:11588:x1875470026106112:12345-192.168.206.33@tcp:34:lhsmtool_posix.0 Request processed in 3569us (4102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587852.566204:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 216 00000100:00100000:0.0:1788587852.569465:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587852.569788:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026106368 00000100:00100000:1.0:1788587852.569797:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026106368 00000100:00100000:1.0:1788587852.569961:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 217 00000100:00100000:1.0:1788587852.569972:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+60:11588:x1875470026106368:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587852.569999:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587852.570018:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9166 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1488 expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.570102:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca916d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.570116:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca916d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.570127:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca916d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587852.570138:0:7276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788587852.570224:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca916d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.570232:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca916d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.570237:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca916d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.570257:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587852.570262:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca916d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.570270:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca916d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.570282:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587852.570285:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788587852.570290:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca916d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.570296:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca916d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.570348:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9166 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1488 expref: 62 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.570358:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44800) 00010000:00010000:1.0:1788587852.570360:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587852.570364:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9166 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1488 expref: 62 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.570373:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1200, rc 0) 00000100:00100000:1.0:1788587852.570439:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+61:11588:x1875470026106368:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 469us (983us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1788587852.570447:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 217 00000100:00100000:3.0:1788587852.575391:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587852.576199:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026106496 00000100:00100000:1.0:1788587852.576289:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026106496 00000100:00100000:1.0:1788587852.576346:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 218 00000100:00100000:1.0:1788587852.576357:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+61:11588:x1875470026106496:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788587852.576430:0:8471:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788587852.578365:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+61:11588:x1875470026106496:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 Request processed in 2000us (2984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587852.578385:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 218 00000100:00100000:2.0:1788587852.585398:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587852.585545:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026106752 00000100:00100000:0.0:1788587852.585556:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026106752 00000100:00100000:0.0:1788587852.585610:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 219 00000100:00100000:0.0:1788587852.585620:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+61:11588:x1875470026106752:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587852.585639:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587852.585642:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788587852.585667:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca910b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db146c expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.585685:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:0.0:1788587852.585690:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587852.585702:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca917b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db148f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788587852.586197:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788587852.586390:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca9182 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.586404:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca9182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.586415:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca9182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.586480:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ba00/0xa13e120d54ca917b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db148f expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.586509:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca9182 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db148f expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.586518:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88f493d34e00) 00010000:00010000:0.0:1788587852.586520:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587852.586523:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a200, rc 0) 00000100:00100000:0.0:1788587852.586646:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+62:11588:x1875470026106752:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 1027us (1255us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788587852.586654:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 219 00000100:00100000:0.0:1788587852.595259:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587852.595513:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026107008 00000100:00100000:1.0:1788587852.595523:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026107008 00000100:00100000:1.0:1788587852.595633:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 220 00000100:00100000:1.0:1788587852.595642:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+62:11588:x1875470026107008:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788587852.595695:0:7276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587852.595720:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca9182 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db148f expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.595739:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88f493d34e00) 00010000:00010000:1.0:1788587852.595748:0:7276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587852.595778:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9190 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.595793:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9190 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.595802:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9190 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.595817:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9197 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf9f15156 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.595883:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf9f15156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.595892:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf9f15156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.595966:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9190 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.595974:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9190 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.595981:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9190 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.595997:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587852.596001:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9190 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.596009:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9190 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.596019:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:1.0:1788587852.596021:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587852.596025:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9190 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.596031:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9190 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.596041:0:7276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf9f15156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.596053:0:7276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9197 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf9f15156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.596059:0:7276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9197 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf9f15156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.596064:0:7276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587852.596067:0:7276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9197 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf9f15156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.596074:0:7276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9197 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf9f15156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.596082:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf9f15156 (ffff88f48fa37900) 00010000:00010000:1.0:1788587852.596085:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587852.596088:0:7276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9197 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf9f15156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.596094:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9197 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf9f15156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587852.596168:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+61:11588:x1875470026107008:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 527us (917us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587852.596175:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 220 00000100:00100000:1.0:1788587852.600136:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587852.600293:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026107136 00000100:00100000:2.0:1788587852.600367:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026107136 00000100:00100000:2.0:1788587852.600426:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 221 00000100:00100000:2.0:1788587852.600437:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+61:11588:x1875470026107136:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587852.600464:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587852.600485:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca919e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1496 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.600530:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca91a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.600544:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca91a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.600556:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca91a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.600894:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca919e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1496 expref: 63 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.600910:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca91a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1496 expref: 62 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.600917:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88f488834400) 00010000:00010000:2.0:1788587852.600920:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587852.600923:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d600, rc 0) 00000100:00100000:2.0:1788587852.600972:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+62:11588:x1875470026107136:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 538us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587852.600979:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 221 00000100:00100000:1.0:1788587852.617247:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587852.617392:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026107392 00000100:00100000:0.0:1788587852.617401:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026107392 00000100:00100000:0.0:1788587852.617502:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 222 00000100:00100000:0.0:1788587852.617513:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+62:11588:x1875470026107392:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587852.617607:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca91ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.617624:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca91ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.617648:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca91ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587852.619194:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1788587852.619222:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 299874378511ns, next at 300874375990ns, rc = 0 00000004:00010000:0.0:1788587852.619324:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa9650c8 reply state 000000005449fab0 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca91ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587852.619335:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587852.619452:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+64:11588:x1875470026107392:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 1938us (2211us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788587852.619460:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 222 00010000:00010000:0.0:1788587852.622552:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca91ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.622567:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca91ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.622574:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca91ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.622590:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77ae00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587852.622594:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca91ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.622602:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca91ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.622618:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88f488834400) 00010000:00010000:0.0:1788587852.622621:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788587852.622626:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca91ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.622642:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77ae00/0xa13e120d54ca91ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587852.624365:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587852.624436:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026107520 00000100:00100000:0.0:1788587852.624445:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026107520 00000100:00100000:0.0:1788587852.624507:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 223 00000100:00100000:0.0:1788587852.624516:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+63:11588:x1875470026107520:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587852.624537:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587852.624555:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca91b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db149d expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.624613:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca91b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db149d expref: 64 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.624626:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca91b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db149d expref: 64 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.624653:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88f488834400) 00010000:00010000:0.0:1788587852.624656:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587852.624659:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a200, rc 0) 00000100:00100000:0.0:1788587852.624708:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+64:11588:x1875470026107520:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 193us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587852.624714:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 223 00000100:00100000:0.0:1788587852.631231:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587852.631320:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026107648 00000100:00100000:2.0:1788587852.631329:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026107648 00000100:00100000:2.0:1788587852.631403:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 63 00000100:00100000:2.0:1788587852.631413:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2347:x1875470026107648:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788587852.631529:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587852.631709:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:2347:x1875470026107648:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 Request processed in 297us (485us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788587852.631718:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 63 00000100:00100000:0.0:1788587852.637351:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587852.637520:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026107904 00000100:00100000:3.0:1788587852.637531:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026107904 00000100:00100000:3.0:1788587852.637591:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 60 00000100:00100000:3.0:1788587852.637600:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+64:11588:x1875470026107904:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788587852.638076:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+65:11588:x1875470026107904:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 Request processed in 475us (733us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788587852.638084:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 60 00000100:00100000:1.0:1788587852.643689:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587852.644046:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026108160 00000100:00100000:2.0:1788587852.644055:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026108160 00000100:00100000:2.0:1788587852.644119:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 224 00000100:00100000:2.0:1788587852.644134:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+65:11588:x1875470026108160:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788587852.644236:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+65:11588:x1875470026108160:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 109us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587852.644245:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 224 00000100:00100000:0.0:1788587852.655597:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587852.655943:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026108288 00000100:00100000:2.0:1788587852.655952:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026108288 00000100:00100000:2.0:1788587852.656006:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 225 00000100:00100000:2.0:1788587852.656016:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+65:11588:x1875470026108288:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587852.656034:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587852.656053:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca91ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db14a4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.656118:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca91c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.656132:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca91c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.656143:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca91c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587852.656195:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587852.656213:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca91c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.656239:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c000/0xa13e120d54ca91ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14a4 expref: 67 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.656255:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca91c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14a4 expref: 66 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.656263:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88f488834400) 00010000:00010000:2.0:1788587852.656266:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788587852.656269:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d000, rc 0) 00000100:00100000:2.0:1788587852.656329:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+66:11588:x1875470026108288:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 314us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587852.656336:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 225 00000100:00100000:0.0:1788587852.671693:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587852.671787:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026108416 00000100:00100000:2.0:1788587852.671796:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026108416 00000100:00100000:2.0:1788587852.671892:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 64 00000100:00100000:2.0:1788587852.671903:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+10:2344:x1875470026108416:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587852.671920:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587852.671939:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca91c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db14ab expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587852.671965:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9baf4b, blocks: 0x1 00010000:00010000:2.0:1788587852.671984:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=299s v=(0 0) 00010000:00010000:2.0:1788587852.672000:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587852.672009:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca91c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14ab expref: 11 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.672026:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca91c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14ab expref: 11 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.672040:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159c000, rc 0) 00000100:00100000:2.0:1788587852.672093:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+11:2344:x1875470026108416:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 193us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587852.672101:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 64 00000100:00100000:1.0:1788587852.693010:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587852.693080:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026108672 00000100:00100000:3.0:1788587852.693091:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026108672 00000100:00100000:3.0:1788587852.693148:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 226 00000100:00100000:3.0:1788587852.693158:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+66:11588:x1875470026108672:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788587852.693255:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+66:11588:x1875470026108672:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587852.693263:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 226 00000100:00100000:0.0:1788587852.706203:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587852.706323:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026108800 00000100:00100000:2.0:1788587852.706332:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026108800 00000100:00100000:2.0:1788587852.706382:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 65 00000100:00100000:2.0:1788587852.706392:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+11:11588:x1875470026108800:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587852.706409:0:9214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587852.706426:0:9214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca91cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db14b2 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.706477:0:9214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca91c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14ab expref: 12 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.706487:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587852.706501:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587852.706508:0:9214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca91cf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b2 expref: 12 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.706552:0:9214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca91c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14ab expref: 12 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.706566:0:9214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca91c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14ab expref: 12 pid: 6693 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587852.706578:0:9214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf741c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9214:1875470043914752:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587852.706668:0:9214:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f493590600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587852.715575:0:9214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf741c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9214:1875470043914752:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587852.715611:0:9214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca91cf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b2 expref: 12 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.715630:0:9214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159c800, rc 0) 00000100:00100000:0.0:1788587852.715905:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587852.715973:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+12:11588:x1875470026108800:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 9581us (9781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587852.715982:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 65 00000100:00100000:3.0:1788587852.716103:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026108928 00000100:00100000:3.0:1788587852.716110:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026108928 00010000:00010000:3.0:1788587852.716147:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca91c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14ab expref: 12 pid: 6693 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587852.716182:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 82 00000100:00100000:3.0:1788587852.716190:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+12:2345:x1875470026108928:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587852.716203:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587852.716222:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca91c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14ab expref: 12 pid: 6693 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.716234:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca91c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14ab expref: 12 pid: 6693 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.716255:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca91c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14ab expref: 12 pid: 6693 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.716269:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587852.716274:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587852.716282:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca91cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b2 expref: 11 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.716292:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca91cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b2 expref: 11 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.716326:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca91cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b2 expref: 11 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587852.716350:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa52300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1875470043914880:192.168.206.33@tcp:105: 00000100:00100000:3.0:1788587852.721616:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4883bf300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587852.725914:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587852.726031:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa52300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1875470043914880:192.168.206.33@tcp:105: 00010000:00010000:3.0:1788587852.726059:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587852.726110:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+11:2345:x1875470026108928:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 9919us (10205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587852.726121:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 82 00000100:00100000:2.0:1788587852.727274:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026109056 00000100:00100000:2.0:1788587852.727283:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026109056 00002000:00100000:2.0:1788587852.727332:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff88f4b4ed2680 x1875470026109056/t0(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:413/0 lens 504/0 e 0 to 0 dl 1788587863 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587852.727344:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4b4ed2680 with x1875470026109056 ext(0->12) 00002000:00010000:2.0:1788587852.727350:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f4b4ed2680 00000100:00100000:2.0:1788587852.727387:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:2.0:1788587852.727411:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+11:2345:x1875470026109056:12345-192.168.206.33@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788587852.729386:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:2345:x1875470026109056:12345-192.168.206.33@tcp:4:lhsmtool_posix.0 Request processed in 1956us (3461us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788587852.729400:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 6 00002000:00100000:2.0:1788587852.729412:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff88f4b4ed2680 x1875470026109056/t4294967320(0) o4->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:413/0 lens 504/448 e 0 to 0 dl 1788587863 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587852.729422:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f4b4ed2680 with x1875470026109056 ext(0->12) 00002000:00010000:2.0:1788587852.729428:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f4b4ed2680 00000100:00100000:1.0:1788587852.736613:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587852.739280:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026109184 00000100:00100000:2.0:1788587852.739296:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026109184 00000100:00100000:2.0:1788587852.739356:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 227 00000100:00100000:2.0:1788587852.739366:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+66:11588:x1875470026109184:12345-192.168.206.33@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788587852.786062:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+66:11588:x1875470026109184:12345-192.168.206.33@tcp:44:lhsmtool_posix.0 Request processed in 46690us (49449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587852.786073:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 227 00000001:00080000:2.0:1788587852.786105:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1788587852.786110:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:2.0:1788587852.786123:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:2.0:1788587852.786177:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788587852.786190:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88f4b4f7b780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788587852.786194:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f4badd4600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88f4b4f7b3c0 00000020:00080000:2.0:1788587852.786197:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f4badd4000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88f4af3bd400 00000020:00080000:2.0:1788587852.786210:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88f4b4f7b840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788587852.786213:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f4baa94200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88f4b4f7b9c0 00000020:00080000:2.0:1788587852.786227:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f4baa94d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88f4bf6e7000 00000001:00080000:2.0:1788587852.786238:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:2.0:1788587852.788727:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788587852.788906:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788587852.788924:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043915264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788587852.788979:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587852.789056:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043915264 00000100:00100000:2.0:1788587852.789062:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043915264 00000100:00100000:2.0:1788587852.789098:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788587852.789106:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043915264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788587852.789127:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1788587852.789155:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9baf49, atime: 0x0, ctime: 0x6a9baf49, blocks: 0xb 00010000:00010000:2.0:1788587852.789163:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000207d8fbc/0xa13e120d54ca91d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.789177:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=300s v=(0 0) 00010000:00010000:2.0:1788587852.789182:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587852.789188:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000207d8fbc/0xa13e120d54ca91d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.789203:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000207d8fbc/0xa13e120d54ca91d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.789213:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000207d8fbc/0xa13e120d54ca91d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.789221:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000207d8fbc/0xa13e120d54ca91d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.789247:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788587852.789743:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043915264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 636us (762us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788587852.789751:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1788587852.789773:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587852.789780:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000207d8fbc/0xa13e120d54ca91d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.789788:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587852.789793:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000207d8fbc/0xa13e120d54ca91d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.789802:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000207d8fbc/0xa13e120d54ca91d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.789817:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000207d8fbc/0xa13e120d54ca91d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.789825:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000207d8fbc/0xa13e120d54ca91d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.789883:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587852.789885:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587852.789887:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587852.789926:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788587852.789931:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1788587852.789957:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88f4bf741880 x1875470043915264/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788587868 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788587852.789968:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88f4bf741880/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788587852.789974:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043915264:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788587852.790113:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043915008:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788587852.790145:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587852.790182:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587852.790188:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043915136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788587852.790210:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587852.790282:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043915008 00000100:00100000:1.0:1788587852.790288:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043915008 00000100:00100000:1.0:1788587852.790336:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043915136 00000100:00100000:1.0:1788587852.790339:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043915136 00000100:00100000:1.0:1788587852.790352:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788587852.790358:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1875470043915008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788587852.790375:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1788587852.790393:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4db7841/0xa13e120d54ca91dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.790410:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8f98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1411 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.790418:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1788587852.790422:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587852.790426:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4db7841/0xa13e120d54ca91dd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.790452:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8f98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1411 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.790466:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8f98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1411 expref: 12 pid: 6694 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587852.790476:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4ed1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1875470043915392:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587852.790547:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874540 going to sleep for 11 seconds 00000100:00080000:0.0:1788587852.790695:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587852.790743:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788587852.790753:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1875470043915136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788587852.790965:0:9214:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788587852.790969:0:9214:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788587851 00002000:00010000:2.0:1788587852.790971:0:9214:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788587852.790973:0:9214:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788587851 -> 1788587851 00002000:00010000:2.0:1788587852.790975:0:9214:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788587852.791061:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3302:x1875470043915136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 311us (849us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788587852.791067:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:0.0:1788587852.791581:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88f4bf742680/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788587852.791589:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043915136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788587852.794976:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587852.795332:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587852.795702:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4ed1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1875470043915392:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587852.795727:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a4db7841/0xa13e120d54ca91dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587852.796229:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026109440 00000100:00100000:3.0:1788587852.796237:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026109440 00010000:00010000:3.0:1788587852.796270:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8f98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1411 expref: 13 pid: 6694 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587852.796400:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 83 00000100:00100000:3.0:1788587852.796411:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+13:2345:x1875470026109440:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587852.796424:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587852.796431:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8f98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1411 expref: 13 pid: 6694 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.796443:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8f98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1411 expref: 13 pid: 6694 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.796464:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e57146d/0xa13e120d54ca8f98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1411 expref: 13 pid: 6694 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.796506:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587852.796510:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587852.796516:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4db7841/0xa13e120d54ca91dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.796525:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4db7841/0xa13e120d54ca91dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.796560:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587852.796608:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+12:2345:x1875470026109440:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 198us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587852.796615:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 83 00010000:00010000:1.0:1788587852.796675:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a4db7841/0xa13e120d54ca91dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.796685:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4db7841/0xa13e120d54ca91dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.796695:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4db7841/0xa13e120d54ca91dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.796704:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4db7841/0xa13e120d54ca91dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.796719:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788587852.797226:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3302:x1875470043915008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6866us (7078us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788587852.797235:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788587852.797251:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026109312 00000100:00100000:1.0:1788587852.797256:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026109312 00000100:00100000:0.0:1788587852.797336:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 69 00000100:00100000:0.0:1788587852.797346:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+12:2344:x1875470026109312:12345-192.168.206.33@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788587852.799872:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587852.799884:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4db7841/0xa13e120d54ca91dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.799914:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0400 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587852.799920:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4db7841/0xa13e120d54ca91dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.799930:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4db7841/0xa13e120d54ca91dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.799949:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4db7841/0xa13e120d54ca91dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.799956:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4db7841/0xa13e120d54ca91dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.799975:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587852.799977:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587852.799978:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788587852.800069:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88f4bf741c00/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788587852.800077:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043915008:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1788587852.827882:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1788587852.827900:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1788587852.828252:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2344:x1875470026109312:12345-192.168.206.33@tcp:16:lhsmtool_posix.0 Request processed in 30903us (33278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587852.828263:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 69 00000100:00100000:2.0:1788587852.832432:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587852.832643:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026109696 00000100:00100000:0.0:1788587852.832651:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026109696 00000100:00100000:0.0:1788587852.832731:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 228 00000100:00100000:0.0:1788587852.832741:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:11588:x1875470026109696:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587852.832787:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587852.832813:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca91c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14a4 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.832829:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88f488834400) 00010000:00010000:0.0:1788587852.832835:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587852.832893:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca91e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.832906:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca91e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.832916:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca91e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587852.833151:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003abb5988 reply state 000000007b1ade0d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca91e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587852.833161:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587852.833251:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:11588:x1875470026109696:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 510us (880us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788587852.833257:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 228 00000100:00100000:1.0:1788587852.842180:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00010000:00010000:3.0:1788587852.843757:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca91e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.843773:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca91e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.843908:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca91e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.843915:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587852.843920:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca91e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.843928:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca91e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.843961:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88f488834400) 00010000:00010000:3.0:1788587852.843965:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587852.843970:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca91e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587852.843977:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b600/0xa13e120d54ca91e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587852.848173:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026109824 00000100:00100000:2.0:1788587852.848186:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026109824 00000100:00100000:2.0:1788587852.848260:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 70 00000100:00100000:2.0:1788587852.848271:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2344:x1875470026109824:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788587852.848632:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788587852.848637:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788587851 -> 1788587850 00002000:00010000:2.0:1788587852.848652:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788587850 00002000:00010000:2.0:1788587852.848654:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788587851 -> 1788587850 00002000:00010000:2.0:1788587852.848657:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788587852.848765:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026109824:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 Request processed in 494us (6593us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788587852.848773:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 70 00000100:00100000:2.0:1788587852.854352:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587852.854621:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026110080 00000100:00100000:1.0:1788587852.854630:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026110080 00000100:00100000:1.0:1788587852.854678:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 229 00000100:00100000:1.0:1788587852.854688:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:11588:x1875470026110080:12345-192.168.206.33@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788587852.854761:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.854796:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca91a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1496 expref: 20 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.854805:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.854837:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca91a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1496 expref: 20 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.854871:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca91a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1496 expref: 20 pid: 8471 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587852.854886:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4ed2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8471:1875470043915520:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587852.854977:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587852.859473:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4ed2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8471:1875470043915520:192.168.206.33@tcp:104: 00000100:00100000:0.0:1788587852.859500:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00010000:00010000:1.0:1788587852.859513:0:8471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587852.859582:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026110208 00000100:00100000:2.0:1788587852.859590:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026110208 00010000:00010000:2.0:1788587852.859626:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca91a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1496 expref: 21 pid: 8471 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587852.859667:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 84 00000100:00100000:2.0:1788587852.859676:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:2344:x1875470026110208:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587852.859690:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587852.859696:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca91a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1496 expref: 21 pid: 8471 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.859708:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca91a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1496 expref: 21 pid: 8471 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.859729:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d600/0xa13e120d54ca91a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1496 expref: 21 pid: 8471 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.859744:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88f488834400) 00010000:00010000:2.0:1788587852.859748:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.859773:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.859781:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.859801:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587852.859874:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:2344:x1875470026110208:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 198us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587852.859882:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 84 00010000:00010000:1.0:1788587852.859987:0:8471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.859995:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.860022:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.860029:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.860043:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.860049:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587852.860053:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.860061:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.860070:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88f488834400) 00010000:00010000:1.0:1788587852.860073:0:8471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788587852.860077:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.860083:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca91eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587852.860136:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:11588:x1875470026110080:12345-192.168.206.33@tcp:55:lhsmtool_posix.0 Request processed in 5449us (5794us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788587852.860144:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 229 00000100:00100000:0.0:1788587852.864655:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587852.865055:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026110336 00000100:00100000:2.0:1788587852.865064:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026110336 00000100:00100000:2.0:1788587852.865158:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 71 00000100:00100000:2.0:1788587852.865169:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2347:x1875470026110336:12345-192.168.206.33@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788587852.865213:0:9214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca91f2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.865232:0:9214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca91cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b2 expref: 8 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.865241:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788587852.865245:0:9214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587852.865249:0:9214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca91f2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.865282:0:9214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca91cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b2 expref: 8 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.865326:0:9214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca91cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b2 expref: 8 pid: 9214 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587852.865341:0:9214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf743480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9214:1875470043915648:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587852.865433:0:9214:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486769c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587852.869302:0:9214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf743480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9214:1875470043915648:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587852.869333:0:9214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca91f2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587852.870791:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587852.871004:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026110464 00000100:00100000:2.0:1788587852.871012:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026110464 00010000:00010000:2.0:1788587852.871046:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca91cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b2 expref: 9 pid: 9214 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587852.871084:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 85 00000100:00100000:2.0:1788587852.871093:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf746300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+9:2345:x1875470026110464:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587852.871107:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587852.871129:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca91cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b2 expref: 9 pid: 9214 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.871142:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca91cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b2 expref: 9 pid: 9214 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.871163:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca91cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b2 expref: 9 pid: 9214 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.871184:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587852.871188:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587852.871208:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca91f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.871217:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca91f2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.871249:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587852.871313:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf746300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2345:x1875470026110464:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 220us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587852.871320:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 85 00010000:00010000:0.0:1788587852.871634:0:9214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca91f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.871645:0:9214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca91f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.871670:0:9214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca91f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.871677:0:9214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca91f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.871697:0:9214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca91f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.871705:0:9214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159da00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:0.0:1788587852.871709:0:9214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca91f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.871718:0:9214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca91f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.871730:0:9214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca91f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.871737:0:9214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca91f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587852.872060:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2347:x1875470026110336:12345-192.168.206.33@tcp:1:lhsmtool_posix.0 Request processed in 6892us (7412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587852.872070:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 71 00000100:00100000:0.0:1788587852.875526:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587852.875631:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026110720 00000100:00100000:2.0:1788587852.875640:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026110720 00000100:00100000:2.0:1788587852.875736:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 230 00000100:00100000:2.0:1788587852.875747:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:11588:x1875470026110720:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788587852.875820:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca91f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.875837:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca91f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.875888:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca91f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.876104:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.876116:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca91b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db149d expref: 20 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.876125:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.876168:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca91b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db149d expref: 20 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.876183:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca91b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db149d expref: 20 pid: 7276 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587852.876197:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf743100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875470043915776:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587852.876261:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486769d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587852.879644:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587852.879714:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026110848 00000100:00100000:1.0:1788587852.879721:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026110848 00010000:00010000:1.0:1788587852.879756:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca91b3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db149d expref: 21 pid: 7276 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587852.879795:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 86 00000100:00100000:1.0:1788587852.879805:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:2345:x1875470026110848:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587852.879833:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587852.879860:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca91b3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db149d expref: 21 pid: 7276 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.879874:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca91b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db149d expref: 21 pid: 7276 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.879894:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88f488834400) 00010000:00010000:1.0:1788587852.879900:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.879909:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.879916:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.879933:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587852.879992:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:2345:x1875470026110848:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 183us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587852.879998:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 86 00010000:00010000:0.0:1788587852.884050:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca91b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db149d expref: 20 pid: 7276 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587852.884079:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf743100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875470043915776:192.168.206.33@tcp:104: 00010000:00010000:0.0:1788587852.884122:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.884209:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.884216:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587852.884458:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788587852.884625:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788587852.884665:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788587852.884757:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4ed2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875470043915904:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788587852.884829:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587852.885078:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874240 going to sleep for 11 seconds 00000100:00100000:0.0:1788587852.885216:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043915904 00000100:00100000:0.0:1788587852.885223:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043915904 00000100:00100000:1.0:1788587852.885438:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587852.885448:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875470043915904:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788587852.885534:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875470043915904:12345-0@lo:1000:mdt00_000.0 Request processed in 88us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587852.885541:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587852.885602:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788587852.885608:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1788587852.885625:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88f4bf742680, transno 4294967321 00000004:00080000:2.0:1788587852.885641:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88f4bf741c00, transno 4294967322 00000100:00100000:2.0:1788587852.885647:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4ed2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875470043915904:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788587852.886117:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788587852.886188:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf743100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875470043916032:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788587852.886226:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587852.886255:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49912fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587852.886436:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043916032 00000100:00100000:3.0:1788587852.886442:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043916032 00000100:00100000:3.0:1788587852.886482:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587852.886498:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875470043916032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788587852.886660:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875470043916032:12345-0@lo:1000:mdt00_000.0 Request processed in 170us (432us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788587852.886668:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587852.886800:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf743100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875470043916032:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788587852.886830:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.886838:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.886865:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.886878:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159cc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587852.886882:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.886890:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.886905:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88f488834400) 00010000:00010000:2.0:1788587852.886908:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587852.886913:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.886918:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159cc00/0xa13e120d54ca9200 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.886945:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9143 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.886951:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9143 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.886956:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9143 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.886960:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587852.886963:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9143 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.886969:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9143 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.887082:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:2.0:1788587852.887086:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587852.887092:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca914a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1481 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.887103:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca914a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1481 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.887112:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca914a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1481 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.887137:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca914a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1481 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587852.887148:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf743480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875470043916160:192.168.206.33@tcp:105: 00000100:00100000:2.0:1788587852.887247:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49912fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587852.890784:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587852.890884:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026110976 00000100:00100000:0.0:1788587852.890892:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026110976 00000100:00100000:0.0:1788587852.890938:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 61 00000100:00100000:0.0:1788587852.890947:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:11587:x1875470026110976:12345-192.168.206.33@tcp:49:lfs.0 00000100:00100000:0.0:1788587852.891070:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:11587:x1875470026110976:12345-192.168.206.33@tcp:49:lfs.0 Request processed in 124us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587852.891077:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 61 00000100:00100000:3.0:1788587852.893688:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587852.893784:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026111232 00000100:00100000:0.0:1788587852.893793:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026111232 00000100:00100000:0.0:1788587852.893876:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 231 00000100:00100000:0.0:1788587852.893886:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:11587:x1875470026111232:12345-192.168.206.33@tcp:58:lfs.0 00000040:00080000:0.0:1788587852.894256:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788587852.894342:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:11587:x1875470026111232:12345-192.168.206.33@tcp:58:lfs.0 Request processed in 456us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587852.894349:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 231 00000100:00100000:1.0:1788587852.894469:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf743480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875470043916160:192.168.206.33@tcp:105: 00010000:00010000:1.0:1788587852.894508:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9143 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894519:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9143 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894549:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9207 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894563:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9207 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894575:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9207 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894585:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9207 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894591:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9207 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894597:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9207 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894611:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587852.894615:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9207 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894622:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9207 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894774:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587852.894778:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587852.894783:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9207 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894790:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0800/0xa13e120d54ca9207 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894802:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca91f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894809:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca91f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894815:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca91f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894820:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587852.894823:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca91f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894829:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca91f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894909:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587852.894911:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788587852.894915:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca91f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.894921:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d400/0xa13e120d54ca91f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587852.895054:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+23:11588:x1875470026110720:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 19307us (19534us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788587852.895063:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 230 00000020:00080000:1.0:1788587852.895068:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788587852.895273:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587852.895278:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587852.895321:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788587852.895327:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788587852.895415:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf743480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875470043916288:192.168.206.33@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788587852.895461:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f49912fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587852.905171:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587852.905248:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026111488 00000100:00100000:0.0:1788587852.905256:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026111488 00000100:00100000:0.0:1788587852.905317:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 62 00000100:00100000:0.0:1788587852.905326:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f489330450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+24:11588:x1875470026111488:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788587852.906236:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788587852.906353:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788587852.906527:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca920e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.906545:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca920e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.906558:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca920e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.906567:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca920e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.906572:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca920e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.906578:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca920e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.906595:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788587852.906679:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f489330450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+26:11588:x1875470026111488:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 Request processed in 1352us (1515us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788587852.906688:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 62 00000020:00080000:0.0:1788587852.906693:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788587852.906877:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf743480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875470043916288:192.168.206.33@tcp:107:hsm_cdtr.0 00010000:00010000:2.0:1788587852.907107:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587852.907114:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca920e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.907128:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a200 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587852.907133:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca920e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.907141:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca920e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.907154:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88f493d34e00) 00010000:00010000:2.0:1788587852.907157:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788587852.907161:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca920e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.907167:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a200/0xa13e120d54ca920e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587852.907185:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587852.907187:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587852.907188:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587852.915827:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587852.916000:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026111616 00000100:00100000:1.0:1788587852.916012:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026111616 00000100:00100000:1.0:1788587852.916067:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 232 00000100:00100000:1.0:1788587852.916077:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+25:11589:x1875470026111616:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788587852.916108:0:8471:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788587852.916207:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5bcb85a0-1673-40ab-a41b-fd8baee9796e+25:11589:x1875470026111616:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 Request processed in 130us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587852.916215:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 232 00000100:00100000:3.0:1788587852.923190:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587852.923299:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026111872 00000100:00100000:0.0:1788587852.923319:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026111872 00000100:00100000:0.0:1788587852.923392:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 233 00000100:00100000:0.0:1788587852.923402:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+25:11589:x1875470026111872:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587852.923426:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587852.923445:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca9215 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db14b9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.923577:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca921c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.923592:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca921c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.923603:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca921c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587852.923614:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788587852.923735:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a800/0xa13e120d54ca9215 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b9 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.923753:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca921c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b9 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.923761:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:0.0:1788587852.923764:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788587852.923767:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b400, rc 0) 00000100:00100000:0.0:1788587852.923829:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+27:11589:x1875470026111872:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 428us (650us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788587852.923836:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 233 00000100:00100000:2.0:1788587852.929197:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587852.929291:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026112128 00000100:00100000:1.0:1788587852.929310:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026112128 00000100:00100000:1.0:1788587852.929365:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 234 00000100:00100000:1.0:1788587852.929384:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+27:11589:x1875470026112128:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788587852.929460:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca922a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.929488:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca922a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.929715:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca922a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.929923:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca922a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.929932:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca922a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.929939:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca922a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.929945:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587852.929950:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca922a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.929957:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca922a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.929970:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587852.929974:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788587852.929978:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca922a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.929985:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca922a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587852.930172:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+28:11589:x1875470026112128:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 797us (982us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788587852.930189:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 234 00000040:00080000:2.0:1788587852.930405:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587852.930409:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587852.930937:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788587852.930945:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587852.933591:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587852.935190:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026112384 00000100:00100000:0.0:1788587852.935205:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026112384 00000100:00100000:0.0:1788587852.935285:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 63 00000100:00100000:0.0:1788587852.935296:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+28:11589:x1875470026112384:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788587852.937674:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+29:11589:x1875470026112384:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 Request processed in 2368us (4081us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788587852.937703:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 63 00000100:00100000:3.0:1788587852.948758:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587852.949622:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026112512 00000100:00100000:0.0:1788587852.949635:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026112512 00000100:00100000:1.0:1788587852.949800:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 235 00000100:00100000:1.0:1788587852.949811:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+29:11591:x1875470026112512:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587852.949835:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587852.949873:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9231 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db14c0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.949934:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca9238 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.949947:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca9238 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.949958:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca9238 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.949970:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca923f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.949976:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca923f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.949982:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca923f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.950279:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9246 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.950290:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db147a expref: 30 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.950438:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9246 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.950472:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db147a expref: 30 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.950496:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db147a expref: 30 pid: 7276 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587852.950581:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4ed3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043916416:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587852.950679:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587852.954519:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587852.954578:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026112768 00000100:00100000:3.0:1788587852.954586:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026112768 00000100:00100000:3.0:1788587852.954640:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 64 00000100:00100000:3.0:1788587852.954650:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+31:5584:x1875470026112768:12345-192.168.206.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788587852.954902:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:5584:x1875470026112768:12345-192.168.206.33@tcp:35:ldlm_bl.0 Request processed in 252us (396us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788587852.954910:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 64 00000100:00100000:2.0:1788587852.957754:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587852.957822:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026112896 00000100:00100000:0.0:1788587852.957830:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026112896 00010000:00010000:0.0:1788587852.957902:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db147a expref: 32 pid: 7276 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587852.957931:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 87 00000100:00100000:0.0:1788587852.957941:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf740700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:2344:x1875470026112896:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587852.957955:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587852.957961:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db147a expref: 32 pid: 7276 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.957975:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db147a expref: 32 pid: 7276 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.958007:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:0.0:1788587852.958013:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9246 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.958023:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.958030:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9246 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587852.958048:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587852.958110:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf740700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:2344:x1875470026112896:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 170us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587852.958119:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 87 00010000:00010000:1.0:1788587852.959138:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77a400/0xa13e120d54ca9135 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db147a expref: 31 pid: 7276 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587852.959158:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4ed3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875470043916416:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587852.959179:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959189:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959195:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587852.959235:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788587852.959240:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587852.959257:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959283:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959293:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca9238 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959299:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca9238 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959306:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca9238 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959312:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587852.959374:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca9238 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959383:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca9238 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959396:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:1.0:1788587852.959399:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587852.959404:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca9238 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959410:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1e00/0xa13e120d54ca9238 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959421:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca923f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959428:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca923f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959440:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca923f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959445:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587852.959448:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca923f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959454:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca923f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959461:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88f48fa37900) 00010000:00010000:1.0:1788587852.959464:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587852.959467:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca923f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959473:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0a00/0xa13e120d54ca923f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959587:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1200/0xa13e120d54ca9231 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14c0 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959602:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14c0 expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587852.959610:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:1.0:1788587852.959612:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587852.959614:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0000, rc 0) 00000100:00100000:1.0:1788587852.959706:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:11591:x1875470026112512:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 9896us (10956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587852.959722:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 235 00010000:00010000:1.0:1788587853.256875:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587853.775797:0:12569:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587853.776011:0:12569:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587853.776069:0:12569:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788587853.776076:0:12569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788587853.909141:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587853.909208:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026113152 00000100:00100000:3.0:1788587853.909217:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026113152 00000100:00100000:3.0:1788587853.909408:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 236 00000100:00100000:3.0:1788587853.909419:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+30:11614:x1875470026113152:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587853.909560:0:7276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587853.909580:0:7276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca924d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db14c7 expref: -99 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587853.909674:0:7276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9254 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587853.909689:0:7276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9254 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587853.909704:0:7276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9254 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587853.909716:0:7276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788587853.909833:0:7276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031000/0xa13e120d54ca924d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14c7 expref: 33 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587853.909878:0:7276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9254 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14c7 expref: 32 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587853.909944:0:7276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:3.0:1788587853.909947:0:7276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788587853.909951:0:7276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031a00, rc 0) 00000100:00100000:3.0:1788587853.910077:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11614:x1875470026113152:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 658us (943us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788587853.910084:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 236 00000100:00100000:2.0:1788587853.917651:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587853.917691:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026113280 00000100:00100000:2.0:1788587853.917705:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026113280 00000100:00100000:2.0:1788587853.917758:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 237 00000100:00100000:2.0:1788587853.917768:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11614:x1875470026113280:12345-192.168.206.33@tcp:54:lfs.0 00010000:00010000:2.0:1788587853.917827:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9262 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587853.917869:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587853.917881:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587853.917906:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587853.917912:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9262 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587853.917919:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9262 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587853.917925:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587853.917929:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9262 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587853.917936:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9262 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587853.917947:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:2.0:1788587853.917950:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587853.917955:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9262 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587853.917970:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159d000/0xa13e120d54ca9262 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587853.918029:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:11614:x1875470026113280:12345-192.168.206.33@tcp:54:lfs.0 Request processed in 262us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587853.918037:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 237 00000100:00100000:2.0:1788587854.004476:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587854.005961:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026113408 00000100:00100000:0.0:1788587854.006061:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026113408 00000100:00100000:0.0:1788587854.006194:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 72 00000100:00100000:0.0:1788587854.006206:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f3838a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2346:x1875470026113408:12345-192.168.206.33@tcp:101:cat.0 00010000:00010000:0.0:1788587854.006223:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587854.006241:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ff4c23c/0xa13e120d54ca9269 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db14ce expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587854.006266:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9baf4a, atime: 0x6a9baf4a, ctime: 0x6a9baf4a, blocks: 0xb 00010000:00010000:0.0:1788587854.006284:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=301s v=(0 0) 00010000:00010000:0.0:1788587854.006289:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587854.006299:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ff4c23c/0xa13e120d54ca9269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14ce expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587854.006316:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ff4c23c/0xa13e120d54ca9269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14ce expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587854.006328:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b200, rc 0) 00000100:00100000:0.0:1788587854.006389:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f3838a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2346:x1875470026113408:12345-192.168.206.33@tcp:101:cat.0 Request processed in 187us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587854.006396:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 72 00000100:00080000:3.0:1788587854.012662:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587854.014653:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587854.014760:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026113536 00000100:00100000:3.0:1788587854.014771:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026113536 00002000:00100000:3.0:1788587854.014966:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff88f383858000 x1875470026113536/t0(0) o3->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:415/0 lens 488/0 e 0 to 0 dl 1788587865 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587854.014977:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f383858000 with x1875470026113536 ext(0->4095) 00002000:00010000:3.0:1788587854.014983:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f383858000 00000100:00100000:3.0:1788587854.015014:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:3.0:1788587854.015023:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026113536:12345-192.168.206.33@tcp:3:cat.0 00000100:00100000:3.0:1788587854.015354:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2344:x1875470026113536:12345-192.168.206.33@tcp:3:cat.0 Request processed in 330us (707us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788587854.015362:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 7 00002000:00100000:3.0:1788587854.015369:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff88f383858000 x1875470026113536/t0(0) o3->5bcb85a0-1673-40ab-a41b-fd8baee9796e@192.168.206.33@tcp:415/0 lens 488/4536 e 0 to 0 dl 1788587865 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587854.015378:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88f383858000 with x1875470026113536 ext(0->4095) 00002000:00010000:3.0:1788587854.015382:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88f383858000 00010000:00010000:2.0:1788587854.280151:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587854.793428:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587854.793458:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043916544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587854.793555:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587854.793989:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043916544 00000100:00100000:0.0:1788587854.794001:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043916544 00000100:00100000:0.0:1788587854.794084:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788587854.794115:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043916544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587854.794171:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587854.794237:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043916544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587854.794257:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788587854.794290:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587854.794339:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043916544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788587855.304636:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587855.816375:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043916800:0@lo:400:kworker.0 00000100:00100000:0.0:1788587855.816468:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587855.816571:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043917312:0@lo:400:kworker.0 00000100:00100000:0.0:1788587855.816606:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587855.816616:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043916928:0@lo:400:kworker.0 00000100:00100000:0.0:1788587855.816647:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788587855.816656:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043916672:0@lo:400:kworker.0 00000100:00100000:2.0:1788587855.816664:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587855.816734:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043916800 00000100:00100000:1.0:1788587855.816744:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043916800 00000100:00100000:1.0:1788587855.816796:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043916928 00000100:00100000:1.0:1788587855.816799:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043916928 00000100:00100000:1.0:1788587855.816830:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788587855.816951:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043916800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587855.822788:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587855.822910:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043916800:12345-0@lo:400:kworker.0 Request processed in 6066us (6438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587855.822927:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788587855.822977:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788587855.822994:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043916928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587855.823061:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043916928:12345-0@lo:400:kworker.0 Request processed in 75us (6405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587855.823068:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:1.0:1788587855.823096:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587855.823158:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043917312 00000100:00100000:1.0:1788587855.823169:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043917312 00000100:00100000:2.0:1788587855.823433:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043916928:0@lo:400:kworker.0 00000100:00100000:1.0:1788587855.824632:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788587855.824644:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875470043917312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587855.824790:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875470043917312:12345-0@lo:400:kworker.0 Request processed in 147us (8183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587855.824798:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788587855.824887:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043917440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587855.824971:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587855.824980:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043917056:0@lo:400:kworker.0 00000100:00100000:1.0:1788587855.825010:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788587855.825036:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587855.825064:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043916672 00000100:00100000:1.0:1788587855.825066:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043917056 00000100:00100000:2.0:1788587855.825072:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043916672 00000100:00100000:1.0:1788587855.825072:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043917056 00000100:00100000:2.0:1788587855.825102:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788587855.825102:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788587855.825109:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f487ae4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3303:x1875470043916672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587855.825110:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875470043917056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587855.825143:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f487ae4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3303:x1875470043916672:12345-0@lo:400:kworker.0 Request processed in 35us (2367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587855.825144:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875470043917056:12345-0@lo:400:kworker.0 Request processed in 35us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587855.825151:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788587855.825151:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788587855.825168:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043917440 00000100:00100000:1.0:1788587855.825171:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043917440 00000100:00100000:1.0:1788587855.825198:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587855.825206:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f383859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043917440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587855.825242:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587855.825625:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f383859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043917440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 419us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587855.825633:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587855.825690:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043917056:0@lo:400:kworker.0 00000100:00100000:1.0:1788587855.825794:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043917440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587855.830286:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043916672:0@lo:400:kworker.0 00000100:00100000:0.0:1788587855.830312:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875470043917184:0@lo:400:kworker.0 00000100:00100000:0.0:1788587855.830420:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587855.830731:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043916800:0@lo:400:kworker.0 00000100:00100000:0.0:1788587855.830748:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043917312:0@lo:400:kworker.0 00000100:00100000:1.0:1788587855.837600:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043917184 00000100:00100000:1.0:1788587855.837633:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043917184 00000100:00100000:1.0:1788587855.837733:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788587855.837745:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875470043917184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587855.837875:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875470043917184:12345-0@lo:400:kworker.0 Request processed in 132us (7456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587855.837883:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788587855.838050:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875470043917184:0@lo:400:kworker.0 00000100:00080000:2.0:1788587855.838338:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788587856.328941:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587856.356726:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587856.356775:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587856.356798:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587856.356820:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587856.356872:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587856.356904:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026114176 00000100:00100000:1.0:1788587856.356915:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026114176 00000100:00100000:1.0:1788587856.357041:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026113792 00000100:00100000:1.0:1788587856.357045:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026113792 00000100:00100000:1.0:1788587856.357073:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 143 00000100:00100000:1.0:1788587856.357084:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2347:x1875470026114176:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587856.357165:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b66627bb-533c-4cf5-aca4-320057d76d08+5:2347:x1875470026114176:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 83us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587856.357174:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 143 00000100:00100000:1.0:1788587856.357206:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 144 00000100:00100000:1.0:1788587856.357214:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:2347:x1875470026113792:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587856.357242:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bcb85a0-1673-40ab-a41b-fd8baee9796e+32:2347:x1875470026113792:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 29us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587856.357250:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 144 00000100:00100000:1.0:1788587856.357271:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026113920 00000100:00100000:1.0:1788587856.357283:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026113920 00000100:00100000:1.0:1788587856.357314:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026114048 00000100:00100000:1.0:1788587856.357317:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026114048 00000100:00100000:1.0:1788587856.357339:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 70 00000100:00100000:1.0:1788587856.357346:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2347:x1875470026113920:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587856.357380:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2347:x1875470026113920:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 35us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587856.357387:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 70 00000100:00100000:1.0:1788587856.357399:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 71 00000100:00100000:1.0:1788587856.357406:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2347:x1875470026114048:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587856.357432:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+8:2347:x1875470026114048:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 26us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587856.357438:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 71 00000100:00100000:2.0:1788587856.357593:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026113664 00000100:00100000:2.0:1788587856.357598:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026113664 00000100:00100000:2.0:1788587856.357642:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 291 00000100:00100000:2.0:1788587856.357658:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2347:x1875470026113664:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587856.357689:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2347:x1875470026113664:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 33us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587856.357695:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 291 00000100:00080000:2.0:1788587856.357734:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587856.357738:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587856.357741:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1788587856.890959:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:2.0:1788587857.351959:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788587857.931419:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1788587857.931441:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1788587857.933170:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:2.0:1788587857.933225:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88f486769d80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788587857.933231:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f48396b800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88f4867699c0 00000020:00080000:2.0:1788587857.933235:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88f48396bb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88f4ba941400 00000020:00080000:0.0:1788587857.933296:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:0.0:1788587857.933542:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788587857.933585:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1788587857.933593:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000100:00100000:2.0:1788587858.006928:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587858.007053:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026114304 00000100:00100000:1.0:1788587858.007068:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026114304 00000100:00100000:1.0:1788587858.007164:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 238 00000100:00100000:1.0:1788587858.007177:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:11267:x1875470026114304:12345-192.168.206.33@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788587858.007309:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:11267:x1875470026114304:12345-192.168.206.33@tcp:60:lhsmtool_posix.0 Request processed in 135us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587858.007318:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 238 00000100:00080000:2.0:1788587858.007383:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587858.013815:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587858.014090:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026114560 00000100:00100000:3.0:1788587858.014103:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026114560 00000100:00100000:3.0:1788587858.014351:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 65 00000100:00100000:3.0:1788587858.014365:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:11267:x1875470026114560:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788587858.014894:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:11267:x1875470026114560:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 Request processed in 530us (1884us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788587858.014905:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 65 00000100:00100000:3.0:1788587858.229195:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587858.229759:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026114688 00000100:00100000:1.0:1788587858.229774:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026114688 00000100:00100000:1.0:1788587858.230602:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 239 00000100:00100000:1.0:1788587858.230618:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b66627bb-533c-4cf5-aca4-320057d76d08+5:12065:x1875470026114688:12345-192.168.206.33@tcp:101:lsof.0 00010000:00010000:1.0:1788587858.230644:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587858.230700:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0400/0xa13e120d54ca9270 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db14d5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587858.230790:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9277 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587858.230808:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587858.230824:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587858.230889:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587858.230894:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587858.230945:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587858.230980:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0400/0xa13e120d54ca9270 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14d5 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587858.231003:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9277 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14d5 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587858.231014:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37300) 00010000:00010000:1.0:1788587858.231017:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587858.231021:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0c00, rc 0) 00000100:00100000:1.0:1788587858.231108:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b66627bb-533c-4cf5-aca4-320057d76d08+6:12065:x1875470026114688:12345-192.168.206.33@tcp:101:lsof.0 Request processed in 493us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587858.231116:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 239 00000100:00080000:3.0:1788587858.231387:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788587858.377533:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587859.400045:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587859.912142:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587859.912313:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043917568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587859.912379:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587859.912595:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043917568 00000100:00100000:1.0:1788587859.912616:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043917568 00000100:00100000:1.0:1788587859.912716:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788587859.912727:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043917568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587859.912761:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587859.912816:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043917568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587859.912823:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788587859.912958:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788587859.912963:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88f4bf741880, transno 4294967310 00000100:00100000:2.0:1788587859.912982:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043917568:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788587859.913573:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788587860.424130:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587860.937444:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043917952:0@lo:400:kworker.0 00000100:00100000:3.0:1788587860.937544:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587860.937612:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043918464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587860.937640:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587860.937674:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587860.937680:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043918080:0@lo:400:kworker.0 00000100:00100000:3.0:1788587860.937714:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587860.941053:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043917696:0@lo:400:kworker.0 00000100:00100000:2.0:1788587860.941182:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043917824:0@lo:400:kworker.0 00000100:00100000:1.0:1788587860.943617:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587860.943689:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043918208:0@lo:400:kworker.0 00000100:00100000:1.0:1788587860.945581:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587860.945679:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043918080 00000100:00100000:1.0:1788587860.945691:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043918080 00000100:00100000:1.0:1788587860.946566:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587860.946585:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043918080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587860.946664:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043918080:12345-0@lo:400:kworker.0 Request processed in 87us (8950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587860.946673:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587860.946712:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043917696 00000100:00100000:1.0:1788587860.946719:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043917696 00000100:00100000:2.0:1788587860.946949:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587860.946995:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043918336:0@lo:400:kworker.0 00000100:00100000:2.0:1788587860.947043:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587860.947083:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043918336 00000100:00100000:2.0:1788587860.947087:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043918336 00000100:00100000:2.0:1788587860.947137:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788587860.947145:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b491ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043918336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587860.947181:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b491ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043918336:12345-0@lo:400:kworker.0 Request processed in 38us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587860.947187:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788587860.947544:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043917952 00000100:00100000:3.0:1788587860.947551:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043917952 00000100:00100000:3.0:1788587860.947589:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043918208 00000100:00100000:3.0:1788587860.947593:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043918208 00000100:00100000:3.0:1788587860.947615:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043917824 00000100:00100000:3.0:1788587860.947618:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043917824 00000100:00100000:3.0:1788587860.947633:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788587860.947640:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043917952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587860.947682:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043917952:12345-0@lo:400:kworker.0 Request processed in 44us (10140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587860.947689:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788587860.947704:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788587860.947710:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043918208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587860.948246:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043918208:12345-0@lo:400:kworker.0 Request processed in 534us (2674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587860.948256:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788587860.948287:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788587860.948917:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788587860.948927:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043917696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587860.948986:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043917696:12345-0@lo:400:kworker.0 Request processed in 61us (5380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587860.948992:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:2.0:1788587860.949177:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587860.949185:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587860.949224:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788587860.949231:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788587860.949261:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043918336:0@lo:400:kworker.0 00000100:00100000:2.0:1788587860.949424:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043918464 00000100:00100000:2.0:1788587860.949431:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043918464 00000100:00100000:2.0:1788587860.949479:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788587860.949486:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043918464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587860.949522:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587860.949564:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043918464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (11923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587860.949571:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788587860.949605:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043918080:0@lo:400:kworker.0 00000100:00100000:2.0:1788587860.949620:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043917952:0@lo:400:kworker.0 00000100:00100000:2.0:1788587860.949634:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043918464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587860.953856:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043917824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587860.954002:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043917824:12345-0@lo:400:kworker.0 Request processed in 186us (7052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587860.958617:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043917696:0@lo:400:kworker.0 00000100:00100000:1.0:1788587860.958656:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043918208:0@lo:400:kworker.0 00000100:00100000:3.0:1788587860.960445:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788587860.960551:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043917824:0@lo:400:kworker.0 00000040:00080000:1.0:1788587861.129366:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587861.129380:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587861.129754:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788587861.129764:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788587861.448326:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587861.471166:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587861.471293:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026114816 00000100:00100000:2.0:1788587861.471308:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026114816 00000100:00100000:1.0:1788587861.471335:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587861.471394:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 293 00000100:00100000:2.0:1788587861.471407:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026114816:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587861.471441:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587861.471583:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026115328 00000100:00100000:0.0:1788587861.471602:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026115328 00000100:00100000:3.0:1788587861.471650:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026115072 00000100:00100000:0.0:1788587861.471657:0:7276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 148 00000100:00100000:3.0:1788587861.471661:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026115072 00000100:00100000:0.0:1788587861.471670:0:7276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b66627bb-533c-4cf5-aca4-320057d76d08+6:2345:x1875470026115328:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587861.471737:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2345:x1875470026114816:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 331us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587861.471750:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 74 00000100:00100000:2.0:1788587861.471751:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 293 00000100:00100000:3.0:1788587861.471771:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026115072:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587861.471885:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587861.471953:0:7276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b66627bb-533c-4cf5-aca4-320057d76d08+6:2345:x1875470026115328:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 282us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587861.471963:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2345:x1875470026115072:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 194us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587861.471974:0:7276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 148 00000100:00100000:3.0:1788587861.471981:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 74 00000100:00100000:0.0:1788587861.472001:0:7276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026114944 00000100:00100000:0.0:1788587861.472009:0:7276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026114944 00000100:00100000:3.0:1788587861.472063:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587861.472501:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026115200 00000100:00100000:3.0:1788587861.472507:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026115200 00000100:00100000:3.0:1788587861.472557:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 75 00000100:00100000:3.0:1788587861.472565:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2345:x1875470026115200:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587861.473408:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2345:x1875470026115200:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 837us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587861.473419:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 75 00000100:00100000:2.0:1788587861.474536:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 149 00000100:00100000:2.0:1788587861.474570:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:2345:x1875470026114944:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587861.474675:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:2345:x1875470026114944:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 127us (2790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587861.474683:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 149 00000100:00080000:0.0:1788587861.474733:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587861.474746:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587861.474750:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788587861.737793:0:12770:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:57:39 (1788587859) 00010000:00010000:0.0:1788587862.472664:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788587863.071336:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1788587863.071383:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788587863.071389:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788587863.071412:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788587863.497156:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587864.523077:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587865.032172:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587865.032204:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043918592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587865.032323:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587865.036413:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043918592 00000100:00100000:0.0:1788587865.036444:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043918592 00000100:00080000:2.0:1788587865.036656:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587865.038200:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788587865.038232:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baf0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043918592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587865.038302:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587865.038424:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baf0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043918592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 208us (6100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587865.038443:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788587865.038797:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043918592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587865.531932:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587865.532223:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026115584 00000100:00100000:3.0:1788587865.532237:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026115584 00000100:00100000:3.0:1788587865.532327:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 66 00000100:00100000:3.0:1788587865.532339:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+19:12286:x1875470026115584:12345-192.168.206.33@tcp:35:umount.0 00000100:00100000:3.0:1788587865.533081:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:12286:x1875470026115584:12345-192.168.206.33@tcp:35:umount.0 Request processed in 741us (1161us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788587865.533092:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 66 00000100:00080000:2.0:1788587865.533174:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587865.543555:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00010000:00010000:2.0:1788587865.544060:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587865.544627:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026115840 00000100:00100000:0.0:1788587865.544644:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026115840 00000100:00100000:0.0:1788587865.545235:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 67 00000100:00100000:0.0:1788587865.545250:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+20:12286:x1875470026115840:12345-192.168.206.33@tcp:35:umount.0 00000100:00100000:0.0:1788587865.545786:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:12286:x1875470026115840:12345-192.168.206.33@tcp:35:umount.0 Request processed in 538us (2244us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788587865.545795:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 67 00000100:00100000:1.0:1788587865.557346:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587865.557474:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026116096 00000100:00100000:3.0:1788587865.557490:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026116096 00000100:00100000:3.0:1788587865.557567:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 68 00000100:00100000:3.0:1788587865.557579:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f489333850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+21:12286:x1875470026116096:12345-192.168.206.33@tcp:35:umount.0 00000100:00100000:3.0:1788587865.557958:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f489333850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:12286:x1875470026116096:12345-192.168.206.33@tcp:35:umount.0 Request processed in 380us (628us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788587865.557968:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 68 00000100:00100000:2.0:1788587865.564967:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587865.565114:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026116352 00000100:00100000:3.0:1788587865.565127:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026116352 00000100:00100000:3.0:1788587865.565188:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 69 00000100:00100000:3.0:1788587865.565201:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+22:12286:x1875470026116352:12345-192.168.206.33@tcp:35:umount.0 00000100:00100000:3.0:1788587865.565678:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bcb85a0-1673-40ab-a41b-fd8baee9796e+23:12286:x1875470026116352:12345-192.168.206.33@tcp:35:umount.0 Request processed in 476us (722us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788587865.565687:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 69 00000100:00100000:1.0:1788587865.572555:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587865.572597:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587865.572639:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587865.572726:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026116864 00000100:00100000:0.0:1788587865.572738:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026116864 00000100:00100000:0.0:1788587865.572810:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026117120 00000100:00100000:0.0:1788587865.572814:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026117120 00000100:00100000:0.0:1788587865.572828:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026116992 00000100:00100000:0.0:1788587865.572831:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026116992 00000100:00100000:0.0:1788587865.572893:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 18 00000100:00100000:0.0:1788587865.572905:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+15:2346:x1875470026116864:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587865.572925:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587865.572951:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481539c00/0xa13e120d54ca828d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1060 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.572972:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587865.573038:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 19 00000100:00100000:0.0:1788587865.573039:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+14:2346:x1875470026116864:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 136us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587865.573066:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+14:2346:x1875470026117120:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587865.573076:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587865.573087:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed5000/0xa13e120d54ca8503 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db112b expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587865.573096:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587865.573118:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+13:2346:x1875470026117120:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 56us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587865.573375:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587865.576938:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026116736 00000100:00100000:3.0:1788587865.576958:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026116736 00000100:00100000:0.0:1788587865.577054:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 18 00000100:00100000:3.0:1788587865.577086:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 73 00000100:00100000:0.0:1788587865.577088:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 20 00000100:00100000:3.0:1788587865.577097:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2343:x1875470026116736:12345-192.168.206.33@tcp:9:umount.0 00000100:00100000:0.0:1788587865.577098:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:2346:x1875470026116992:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587865.577126:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:3.0:1788587865.577138:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8828 00000020:00010000:3.0:1788587865.577147:0:6695:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88f491fdc800: total 0 00010000:00010000:0.0:1788587865.577157:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed4200/0xa13e120d54ca8255 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1028 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788587865.577169:0:6695:0:(import.c:65:import_set_state_nolock()) ffff88f491fdf000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788587865.577179:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:3.0:1788587865.577225:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788587865.577258:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:2346:x1875470026116992:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 163us (4618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587865.577266:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 20 00000020:00010000:0.0:1788587865.577344:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88f491fdc800: total 0 00010000:00010000:0.0:1788587865.577387:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88f491fdc800, canceled 0 locks, left on hash table 2. 00000100:00080000:1.0:1788587865.577470:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587865.577548:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2343:x1875470026116736:12345-192.168.206.33@tcp:9:umount.0 Request processed in 453us (4174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587865.577556:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 19 00000100:00100000:3.0:1788587865.577562:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 73 00010000:00010000:0.0:1788587865.578269:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000455e124c/0xa13e120d54ca8bcb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1300 expref: 4 pid: 9214 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.578313:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ff4c23c/0xa13e120d54ca9269 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14ce expref: 3 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.578331:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88f491fdc800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788587865.578352:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587865.578355:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587865.578356:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587865.588250:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587865.588344:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026117248 00000100:00100000:2.0:1788587865.588359:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026117248 00000100:00100000:2.0:1788587865.588465:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 74 00000100:00100000:2.0:1788587865.588477:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+5:2343:x1875470026117248:12345-192.168.206.33@tcp:9:umount.0 00000020:00000080:2.0:1788587865.588523:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca85c7 00000100:00080000:2.0:1788587865.588536:0:6693:0:(import.c:65:import_set_state_nolock()) ffff88f499076000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587865.588654:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1788587865.588738:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587865.590301:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587865.590506:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+2:2343:x1875470026117248:12345-192.168.206.33@tcp:9:umount.0 Request processed in 2020us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587865.590522:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 74 00000100:00100000:1.0:1788587865.599468:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587865.599571:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026118272 00000100:00100000:3.0:1788587865.599585:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026118272 00000100:00100000:3.0:1788587865.599655:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 240 00000100:00100000:3.0:1788587865.599668:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+23:2343:x1875470026118272:12345-192.168.206.33@tcp:39:umount.0 00000020:00000080:3.0:1788587865.599712:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8263 00000020:00010000:3.0:1788587865.599732:0:5841:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88f4bf7da800: total 0 00000100:00080000:3.0:1788587865.599738:0:5841:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb08000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788587865.599775:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1788587865.600196:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88f4bf7da800: total 0 00010000:00010000:0.0:1788587865.600202:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587865.600259:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88f4bf7da800, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1788587865.600304:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:0.0:1788587865.600309:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587865.600320:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77aa00/0xa13e120d54ca8aac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12b3 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.600348:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:0.0:1788587865.600351:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788587865.600355:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4c159c600/0xa13e120d54ca859d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1155 expref: 21 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.600370:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:0.0:1788587865.600373:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587865.600376:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca914a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1481 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.600417:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:0.0:1788587865.600420:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587865.600435:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9246 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14c0 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.600450:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88f488834c00) 00010000:00010000:0.0:1788587865.600453:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788587865.600456:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca888a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1227 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.600479:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:0.0:1788587865.600482:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788587865.600486:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031800/0xa13e120d54ca8c49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1323 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.600499:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37300) 00010000:00010000:0.0:1788587865.600502:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587865.600506:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1000/0xa13e120d54ca8c2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db131c expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.600519:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44800) 00010000:00010000:0.0:1788587865.600521:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587865.600525:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5600/0xa13e120d54ca8549 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1140 expref: 15 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.600541:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:0.0:1788587865.600543:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587865.600554:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1a00/0xa13e120d54ca8b8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12eb expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.600569:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:0.0:1788587865.600572:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788587865.600575:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b400/0xa13e120d54ca921c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14b9 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.600587:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88f484d44300) 00010000:00010000:0.0:1788587865.600589:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788587865.600593:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b000/0xa13e120d54ca8f28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db13f5 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.600613:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88f488834b00) 00010000:00010000:0.0:1788587865.600616:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788587865.600620:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9254 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14c7 expref: 11 pid: 7276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.600635:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88f489033600) 00010000:00010000:0.0:1788587865.600638:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587865.600642:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bf77b800/0xa13e120d54ca852d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1139 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.600660:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88f489033100) 00010000:00010000:0.0:1788587865.600663:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788587865.600667:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030400/0xa13e120d54ca8bb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db12f9 expref: 9 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587865.600683:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88f4bf7da800, canceled 14 locks, left on hash table 0. 00010000:00010000:0.0:1788587865.600703:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587865.600705:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587865.600707:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587865.601713:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bcb85a0-1673-40ab-a41b-fd8baee9796e+7:2343:x1875470026118272:12345-192.168.206.33@tcp:39:umount.0 Request processed in 2038us (2252us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788587865.601728:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 240 00000100:00100000:0.0:1788587866.056437:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043919104:0@lo:400:kworker.0 00000100:00100000:0.0:1788587866.056530:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587866.056608:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587866.056616:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043918976:0@lo:400:kworker.0 00000100:00100000:1.0:1788587866.056644:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043918720:0@lo:400:kworker.0 00000100:00100000:0.0:1788587866.056652:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587866.056698:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587866.056714:0:9214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043919104 00000100:00100000:1.0:1788587866.056732:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043919232:0@lo:400:kworker.0 00000100:00100000:1.0:1788587866.056758:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587866.056779:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788587866.056784:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043918848:0@lo:400:kworker.0 00000100:00100000:1.0:1788587866.056806:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587866.056823:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043919360:0@lo:400:kworker.0 00000100:00100000:1.0:1788587866.056913:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587866.056943:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043918976 00000100:00100000:1.0:1788587866.056952:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043918720 00000100:00100000:2.0:1788587866.056954:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043918976 00000100:00100000:1.0:1788587866.056959:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043918720 00000100:00100000:1.0:1788587866.057014:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788587866.057027:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043919232 00000100:00100000:1.0:1788587866.057027:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043918720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587866.057032:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043919232 00000100:00100000:2.0:1788587866.057056:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043918848 00000100:00100000:2.0:1788587866.057060:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043918848 00000100:00100000:2.0:1788587866.057075:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788587866.057083:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043918976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587866.057149:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043918976:12345-0@lo:400:kworker.0 Request processed in 66us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587866.057166:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043918720:12345-0@lo:400:kworker.0 Request processed in 141us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587866.057167:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788587866.057179:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788587866.057208:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788587866.057218:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043919232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587866.057225:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788587866.057237:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043918848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587866.057259:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043919232:12345-0@lo:400:kworker.0 Request processed in 42us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587866.057267:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788587866.057284:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043918848:12345-0@lo:400:kworker.0 Request processed in 47us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587866.057292:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788587866.057319:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043919360 00000100:00080000:1.0:1788587866.057320:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587866.057326:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043919360 00000100:00100000:2.0:1788587866.057367:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788587866.057371:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043918848:0@lo:400:kworker.0 00000100:00100000:2.0:1788587866.057380:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043919360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587866.057391:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043918720:0@lo:400:kworker.0 00000100:00100000:1.0:1788587866.057405:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043919232:0@lo:400:kworker.0 00000100:00100000:2.0:1788587866.057437:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043919360:12345-0@lo:400:kworker.0 Request processed in 60us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587866.057445:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788587866.057451:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043919360:0@lo:400:kworker.0 00000100:00080000:1.0:1788587866.057472:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587866.057518:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043918976:0@lo:400:kworker.0 00000100:00100000:0.0:1788587866.058475:0:9214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043919104 00000100:00100000:1.0:1788587866.058511:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587866.058531:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043919488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587866.058544:0:9214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788587866.058554:0:9214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043919104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587866.058594:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587866.058615:0:9214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043919104:12345-0@lo:400:kworker.0 Request processed in 63us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587866.058622:0:9214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788587866.058749:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043919104:0@lo:400:kworker.0 00000100:00100000:0.0:1788587866.058899:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043919488 00000100:00100000:0.0:1788587866.058903:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043919488 00000100:00100000:0.0:1788587866.058942:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788587866.058949:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043919488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587866.058987:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587866.059026:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043919488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587866.059032:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788587866.059135:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043919488:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788587866.568137:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587866.597952:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587866.598010:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587866.598061:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026118400 00000100:00100000:2.0:1788587866.598074:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026118400 00000100:00100000:2.0:1788587866.598154:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 295 00000100:00100000:2.0:1788587866.598166:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2347:x1875470026118400:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587866.598262:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2347:x1875470026118400:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 99us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587866.598271:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 295 00000100:00100000:0.0:1788587866.598532:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026118528 00000100:00100000:0.0:1788587866.598537:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026118528 00000100:00100000:0.0:1788587866.598603:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 153 00000100:00100000:0.0:1788587866.598612:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b66627bb-533c-4cf5-aca4-320057d76d08+6:2347:x1875470026118528:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:0.0:1788587866.598677:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b66627bb-533c-4cf5-aca4-320057d76d08+6:2347:x1875470026118528:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 66us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587866.598685:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 153 00000100:00080000:1.0:1788587866.598870:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1788587867.184371:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000020:00000080:1.0:1788587867.184386:0:6718:0:(genops.c:885:class_export_put()) final put ffff88f493ef9800/5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000020:00000080:0.0:1788587867.184535:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f493ef9800/5bcb85a0-1673-40ab-a41b-fd8baee9796e for lustre-OST0000 00000020:00000080:0.0:1788587867.184616:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f499076000 for lustre-OST0000 00000100:00100000:3.0:1788587867.309617:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587867.309664:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587867.309716:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587867.311793:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026118656 00000100:00100000:0.0:1788587867.311815:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026118656 00000100:00100000:0.0:1788587867.311983:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026118912 00000100:00100000:0.0:1788587867.311987:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026118912 00000100:00100000:0.0:1788587867.312005:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026118784 00000100:00100000:0.0:1788587867.312009:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026118784 00000100:00100000:0.0:1788587867.312035:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 21 00000100:00100000:0.0:1788587867.312046:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+12:2344:x1875470026118656:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587867.312067:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587867.312096:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed4800/0xa13e120d54ca8335 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1075 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587867.312121:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587867.312313:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 22 00000100:00100000:3.0:1788587867.312324:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+11:2344:x1875470026118912:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587867.312334:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587867.312364:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed5c00/0xa13e120d54ca84fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1124 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587867.312374:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587867.312411:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+10:2344:x1875470026118912:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 76us (2732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587867.312429:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 22 00000100:00100000:3.0:1788587867.312454:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 23 00000100:00100000:3.0:1788587867.312461:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f485d6b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+9:2344:x1875470026118784:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587867.312470:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587867.312480:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4c159d200/0xa13e120d54ca833c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db109f expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587867.312490:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587867.312509:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f485d6b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+8:2344:x1875470026118784:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 49us (2793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587867.312516:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 23 00000100:00100000:0.0:1788587867.312986:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+7:2344:x1875470026118656:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 939us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587867.312995:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 21 00000100:00100000:0.0:1788587867.327032:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587867.328371:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026119168 00000100:00100000:2.0:1788587867.328392:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026119168 00000100:00100000:2.0:1788587867.328555:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 241 00000100:00100000:2.0:1788587867.328570:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b66627bb-533c-4cf5-aca4-320057d76d08+6:2343:x1875470026119168:12345-192.168.206.33@tcp:39:umount.0 00000020:00000080:2.0:1788587867.328630:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca834a 00000020:00010000:2.0:1788587867.328659:0:5842:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88f4bf84e800: total 0 00000100:00080000:2.0:1788587867.328665:0:5842:0:(import.c:65:import_set_state_nolock()) ffff88f4bf84c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587867.328724:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1788587867.329193:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b66627bb-533c-4cf5-aca4-320057d76d08+5:2343:x1875470026119168:12345-192.168.206.33@tcp:39:umount.0 Request processed in 623us (2173us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788587867.329203:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 241 00000020:00010000:0.0:1788587867.329641:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88f4bf84e800: total 0 00010000:00010000:0.0:1788587867.329700:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88f4bf84e800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788587867.329745:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37300) 00010000:00010000:0.0:1788587867.329749:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587867.329761:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9277 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14d5 expref: 4 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587867.329810:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88f4bf84e800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788587867.329823:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587867.329825:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587867.329827:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587867.354656:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587867.355466:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026119424 00000100:00100000:1.0:1788587867.355484:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026119424 00000100:00100000:1.0:1788587867.355617:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 296 00000100:00100000:1.0:1788587867.355631:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f486795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+7:2343:x1875470026119424:12345-192.168.206.33@tcp:251:umount.0 00000020:00000080:1.0:1788587867.355709:0:5836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8240 00000020:00010000:1.0:1788587867.355720:0:5836:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88f4b50f9800: total 0 00000100:00080000:1.0:1788587867.355726:0:5836:0:(import.c:65:import_set_state_nolock()) ffff88f4b50ff000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788587867.355827:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f486795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14b4c4f4-b2bd-4677-ba5e-e54a3823d28b+3:2343:x1875470026119424:12345-192.168.206.33@tcp:251:umount.0 Request processed in 199us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587867.355837:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 296 00000020:00010000:3.0:1788587867.355947:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88f4b50f9800: total 0 00010000:00010000:3.0:1788587867.355952:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587867.356022:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88f4b50f9800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788587867.356061:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481669e00/0xa13e120d54ca8294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1067 expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587867.356092:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88f4b50f9800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788587867.356102:0:5829:0:(genops.c:885:class_export_put()) final put ffff88f4b50f9800/14b4c4f4-b2bd-4677-ba5e-e54a3823d28b 00010000:00010000:3.0:1788587867.356118:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587867.356120:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587867.356139:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788587867.356151:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4b50f9800/14b4c4f4-b2bd-4677-ba5e-e54a3823d28b for MGS 00000020:00000080:3.0:1788587867.356188:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4b50ff000 for MGS 00010000:00010000:0.0:1788587867.592392:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788587868.159264:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00100000:1.0:1788587868.159283:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b66627bb-533c-4cf5-aca4-320057d76d08 00000001:00080000:1.0:1788587868.159289:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788587868.159292:0:5863:0:(genops.c:885:class_export_put()) final put ffff88f4bf84e800/b66627bb-533c-4cf5-aca4-320057d76d08 00000001:00100000:1.0:1788587868.159306:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000001:00080000:1.0:1788587868.159312:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1788587868.159317:0:5863:0:(genops.c:885:class_export_put()) final put ffff88f4bf7da800/5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000020:00000080:3.0:1788587868.159832:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bf84e800/b66627bb-533c-4cf5-aca4-320057d76d08 for lustre-MDT0000 00000020:00000080:3.0:1788587868.159909:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bf7da800/5bcb85a0-1673-40ab-a41b-fd8baee9796e for lustre-MDT0000 00000020:00000080:3.0:1788587868.159940:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4bf84c000 for lustre-MDT0000 00000020:00000080:3.0:1788587868.159945:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4bfb08000 for lustre-MDT0000 00000001:00100000:0.0:1788587868.183376:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000020:00000080:0.0:1788587868.183384:0:7648:0:(genops.c:885:class_export_put()) final put ffff88f491fdc800/5bcb85a0-1673-40ab-a41b-fd8baee9796e 00000020:00000080:1.0:1788587868.183459:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f491fdc800/5bcb85a0-1673-40ab-a41b-fd8baee9796e for lustre-OST0001 00000020:00000080:1.0:1788587868.183509:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f491fdf000 for lustre-OST0001 00010000:00010000:0.0:1788587868.617201:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788587869.089281:0:12973:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788587869.110613:0:12973:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788587869.110732:0:12973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.110757:0:12973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.110765:0:12973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.110772:0:12973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.110836:0:12973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788587869.110868:0:12973:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788587869.110890:0:12973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587869.110894:0:12973:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788587869.110899:0:12973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788587869.110926:0:12973:0:(import.c:65:import_set_state_nolock()) ffff88f4afd9d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788587869.112222:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875470043919616:0@lo:39:umount.0 00000100:00100000:2.0:1788587869.112298:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587869.112433:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043919616 00000100:00100000:3.0:1788587869.112442:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043919616 00000100:00100000:3.0:1788587869.112494:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788587869.112504:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875470043919616:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788587869.112531:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca804f 00000100:00080000:3.0:1788587869.112539:0:5841:0:(import.c:65:import_set_state_nolock()) ffff88f4857c1000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788587869.112639:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587869.112649:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587869.112659:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481669600 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:0.0:1788587869.112663:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587869.112673:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587869.112680:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587869.112686:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587869.112688:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788587869.112691:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788587869.112720:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587869.112726:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788587869.112784:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788587869.112802:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587869.112810:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481669600/0xa13e120d54ca82f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca82fd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587869.112824:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587869.112826:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587869.112828:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587869.113041:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043919744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587869.113081:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587869.113250:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3301:x1875470043919616:12345-0@lo:39:umount.0 Request processed in 746us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587869.113259:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788587869.113271:0:5841:0:(genops.c:885:class_export_put()) final put ffff88f4857c7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788587869.113297:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4857c7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788587869.113342:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4857c1000 for lustre-MDT0000 00000100:00080000:3.0:1788587869.113376:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4afd9d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788587869.113386:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875470043919616:0@lo:39:umount.0 00010000:00010000:1.0:1788587869.113445:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587869.113457:0:12973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587869.113461:0:12973:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788587869.113466:0:12973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788587869.114469:0:12973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114483:0:12973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114490:0:12973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114512:0:12973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114531:0:12973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587869.114538:0:12973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114545:0:12973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114551:0:12973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114557:0:12973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114572:0:12973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788587869.114584:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587869.114589:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114595:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481539000 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:1.0:1788587869.114598:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114606:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587869.114612:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587869.114624:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587869.114626:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788587869.114650:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114655:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587869.114673:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114679:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481539000/0xa13e120d54ca8304 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca830b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114692:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587869.114695:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114700:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481538c00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:1.0:1788587869.114702:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114708:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587869.114714:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587869.114719:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587869.114721:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788587869.114723:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788587869.114744:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114750:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587869.114756:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114763:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481538c00/0xa13e120d54ca81fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca8201 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.114776:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587869.114777:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587869.114779:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587869.114794:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043919872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587869.114866:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587869.114921:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587869.115338:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043920000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587869.116430:0:12973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.116446:0:12973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.116454:0:12973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.116463:0:12973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.116486:0:12973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587869.116496:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587869.116502:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.116519:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4c00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:1.0:1788587869.116523:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.116532:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587869.116540:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587869.116546:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788587869.116548:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788587869.116550:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1788587869.116658:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587869.116693:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.116700:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587869.116720:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.116729:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f4baed4c00/0xa13e120d54ca84ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.116743:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587869.116745:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587869.116747:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587869.116753:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587869.116765:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043920128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587869.116807:0:12973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480030e00/0xa13e120d54ca7fae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.116822:0:12973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480030e00/0xa13e120d54ca7fae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.116830:0:12973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480030e00/0xa13e120d54ca7fae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.116837:0:12973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.133@tcp lock: ffff88f480030e00/0xa13e120d54ca7fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.116866:0:12973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788587869.116870:0:12973:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788587869.116873:0:12973:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788587869.116901:0:12973:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788587869.116905:0:12973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788587869.116909:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587869.116915:0:12973:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788587869.116919:0:12973:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff88f4bfb0a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587869.116924:0:12973:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff88f4bfb41000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587869.116929:0:12973:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff88f4c19199c0) has exports, disconnecting them 00000020:00080000:1.0:1788587869.116932:0:12973:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88f4bfb0a800), last request at 1788587866 00000020:00000080:1.0:1788587869.116939:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca81c2 00000100:00080000:1.0:1788587869.116953:0:12973:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb0e000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788587869.116986:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587869.116990:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f480030e00/0xa13e120d54ca7fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.116996:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030e00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:1.0:1788587869.116998:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f480030e00/0xa13e120d54ca7fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.117011:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f480030e00/0xa13e120d54ca7fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587869.117016:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f480030e00/0xa13e120d54ca7fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587869.117022:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587869.117024:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788587869.117026:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788587869.117041:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f480030e00/0xa13e120d54ca7fae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.117047:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587869.117057:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f480030e00/0xa13e120d54ca7fae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.117064:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f480030e00/0xa13e120d54ca7fae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca7fb5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587869.117077:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587869.117079:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587869.117081:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788587869.117096:0:12973:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88f4bfb0a800): rc 0 00000020:00000080:1.0:1788587869.117099:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f4bfb0a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788587869.117107:0:12973:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88f4bfb41000), last request at 1788587866 00000020:00000080:1.0:1788587869.117111:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca80e9 00000100:00080000:1.0:1788587869.117116:0:12973:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb46800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788587869.117125:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788587869.117131:0:12973:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88f4bfb41000): rc 0 00000020:00000080:1.0:1788587869.117138:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f4bfb41000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788587869.117145:0:12973:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa0dd03c4fae0 00000100:00080000:1.0:1788587869.117163:0:12973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788587869.117166:0:12973:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788587869.117176:0:12973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788587869.117232:0:12973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788587869.117244:0:12973:0:(import.c:65:import_set_state_nolock()) ffff88f4b487d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788587869.117256:0:12973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788587869.117259:0:12973:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788587869.117266:0:12973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788587869.117334:0:12973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788587869.117341:0:12973:0:(import.c:65:import_set_state_nolock()) ffff88f4c1910000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788587869.117366:0:12973:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff88f4c19199c0) has no exports 00000100:00100000:0.0:1788587869.117767:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043919744 00000100:00100000:0.0:1788587869.117776:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043919744 00000100:00100000:3.0:1788587869.118152:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043919872 00000100:00100000:3.0:1788587869.118157:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043919872 00000100:00100000:3.0:1788587869.118178:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043920000 00000100:00100000:3.0:1788587869.118180:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043920000 00000100:00100000:3.0:1788587869.118197:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788587869.118206:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382305500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+21:3304:x1875470043919744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587869.118228:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587869.118242:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed4600/0xa13e120d54ca82fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca82f6 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587869.118256:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587869.118297:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382305500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+20:3304:x1875470043919744:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (5215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587869.118303:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788587869.118320:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587869.118325:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5337480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+19:3302:x1875470043919872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587869.118333:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587869.118341:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed5a00/0xa13e120d54ca830b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca8304 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587869.118348:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587869.118376:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5337480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+18:3302:x1875470043919872:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (3510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587869.118382:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587869.118396:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788587869.118402:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+17:3303:x1875470043920000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587869.118422:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587869.118430:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481538400/0xa13e120d54ca8201 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca81fa expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587869.118441:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587869.118467:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:3303:x1875470043920000:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587869.118483:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788587869.118591:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:52de7536-38dc-49e6-9b51-4cdaba805a7b:3302:1875470043919872:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788587869.118612:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bfb0a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788587869.118835:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bfb41000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788587869.118875:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4bfb0e000 for lustre-MDT0000 00000020:00000080:3.0:1788587869.118880:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4bfb46800 for lustre-MDT0000 00000100:00100000:3.0:1788587869.118901:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043920000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587869.118919:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043920384:0@lo:9:umount.0 00000100:00100000:3.0:1788587869.118953:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587869.118975:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043920512:0@lo:9:umount.0 00000100:00100000:3.0:1788587869.118994:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587869.119021:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043920384 00000100:00100000:3.0:1788587869.119025:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043920384 00000100:00100000:3.0:1788587869.119060:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043920512 00000100:00100000:3.0:1788587869.119063:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043920512 00000100:00100000:3.0:1788587869.119083:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788587869.119089:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875470043920384:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788587869.119110:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8136 00000100:00080000:3.0:1788587869.119118:0:6695:0:(import.c:65:import_set_state_nolock()) ffff88f4b487c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788587869.119153:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788587869.119455:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3301:x1875470043920384:12345-0@lo:9:umount.0 Request processed in 365us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587869.119462:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788587869.119475:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788587869.119481:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875470043920512:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788587869.119502:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca822b 00000100:00080000:3.0:1788587869.119508:0:6695:0:(import.c:65:import_set_state_nolock()) ffff88f381d12000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788587869.119524:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:0.0:1788587869.119889:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587869.119894:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788587869.119904:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587869.120178:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3301:x1875470043920512:12345-0@lo:9:umount.0 Request processed in 696us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587869.120186:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1788587869.120202:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788587869.120284:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4b487d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788587869.120296:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788587869.120298:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587869.120302:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043920384:0@lo:9:umount.0 00000100:00080000:3.0:1788587869.120312:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4c1910000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788587869.120319:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788587869.120320:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587869.120322:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043920512:0@lo:9:umount.0 00000100:00100000:1.0:1788587869.121001:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043919744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587869.121018:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587869.121028:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043920256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587869.121066:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587869.121165:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043920256 00000100:00100000:3.0:1788587869.121171:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043920256 00000100:00100000:3.0:1788587869.121216:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587869.121224:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+16:3304:x1875470043920256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587869.121236:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587869.121252:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4c21d5a00/0xa13e120d54ca7fb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca7fae expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587869.121268:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587869.121299:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:3304:x1875470043920256:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587869.121306:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587869.121330:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043920256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587869.121747:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587869.121823:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043920128 00000100:00100000:0.0:1788587869.121828:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043920128 00000100:00100000:0.0:1788587869.121891:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587869.121899:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382304e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+15:3305:x1875470043920128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587869.121907:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587869.121917:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed4a00/0xa13e120d54ca84f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca84ee expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587869.121928:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587869.121958:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382304e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52de7536-38dc-49e6-9b51-4cdaba805a7b+14:3305:x1875470043920128:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587869.121964:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788587869.122061:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:52de7536-38dc-49e6-9b51-4cdaba805a7b:3305:1875470043920128:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788587869.133108:0:12973:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff88f4c19199c0) has no exports 00000020:00000080:1.0:1788587869.180913:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8009 00000020:00000080:1.0:1788587869.180931:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f4c1915000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788587869.180998:0:12973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788587869.181039:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4c1915000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788587869.181078:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587869.181089:0:12973:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788587869.181094:0:12973:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff88f4c1918000) has no exports 00000020:00000080:2.0:1788587869.182901:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8002 00000020:00000080:2.0:1788587869.182914:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f4afd86000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788587869.182990:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587869.183002:0:12973:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788587869.183005:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f4c1924800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788587869.183008:0:12973:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4c1924800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788587869.183022:0:12973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788587869.183245:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4afd86000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788587869.183458:0:12973:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88f48561a600 - data ffff88f4bfe93438/ffff88f4baaae000 00000020:01000000:2.0:1788587869.183591:0:12973:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88f485c0d9c0 - data ffff88f49d75c6c0/ffff88f4afdb9800 00000001:00000004:2.0:1788587869.196052:0:12973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788587869.263618:0:12973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788587869.263627:0:12973:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788587869.263974:0:12973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587869.263978:0:12973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788587869.264394:0:6732:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788587869.264399:0:6732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788587869.264418:0:6732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788587869.265678:0:12973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788587869.265684:0:12973:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788587869.265735:0:12973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587869.265737:0:12973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788587869.266374:0:7953:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788587869.266378:0:7953:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788587869.266396:0:7953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788587869.312681:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca7fd1 00000020:00000080:2.0:1788587869.312693:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f48661c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788587869.313602:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f48661c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788587869.313784:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca7fe6 00000020:00000080:2.0:1788587869.313791:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f4c1925000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788587869.313839:0:12973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788587869.313860:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587869.313868:0:12973:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788587869.313872:0:12973:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff88f4c191b380) has no exports 00000004:01000000:2.0:1788587869.314026:0:12973:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788587869.314034:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8224 00000020:00000080:2.0:1788587869.314039:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f4b50fe800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788587869.314183:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4c1925000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788587869.314273:0:12973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788587869.314282:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587869.314309:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4b50fe800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788587869.314361:0:12973:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788587869.314364:0:12973:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff88f48702cd40) has no exports 00000020:00000080:2.0:1788587869.314370:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca821d 00000020:00000080:2.0:1788587869.314375:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f4c1914000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788587869.314749:0:12973:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788587869.314754:0:12973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788587869.314758:0:12973:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788587869.314763:0:12973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587869.314765:0:12973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788587869.314798:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4c1914000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788587869.314996:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587869.315004:0:12973:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587869.315022:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca812f 00000020:00000080:2.0:1788587869.315027:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f4bfb1d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587869.315048:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4c1910000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788587869.315053:0:36:0:(genops.c:885:class_export_put()) final put ffff88f4b50ff800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587869.315055:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4b50ff800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788587869.315060:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788587869.315195:0:12973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788587869.315199:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587869.315204:0:12973:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788587869.315207:0:12973:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff88f4870299c0) has no exports 00000020:00000080:2.0:1788587869.315211:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8128 00000020:00000080:2.0:1788587869.315215:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f486732000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788587869.315238:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bfb1d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1788587869.315639:0:12973:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788587869.315642:0:12973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788587869.315645:0:12973:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788587869.315649:0:12973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587869.315650:0:12973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788587869.315675:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f486732000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788587869.315765:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587869.315771:0:12973:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587869.315798:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587869.315801:0:12973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587869.315805:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f49d37f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788587869.315807:0:12973:0:(genops.c:844:class_export_destroy()) destroying export ffff88f49d37f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788587869.315811:0:12973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587869.316074:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca7fed 00000020:00000080:2.0:1788587869.316081:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f4c1927800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788587869.316122:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4b487d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788587869.316127:0:36:0:(genops.c:885:class_export_put()) final put ffff88f4bfb0d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587869.316129:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bfb0d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788587869.316132:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788587869.316271:0:12973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788587869.316276:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587869.316281:0:12973:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788587869.316284:0:12973:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff88f4c191cd40) has no exports 00000020:00000080:2.0:1788587869.316302:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587869.316305:0:12973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788587869.316308:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca7ff4 00000020:00000080:2.0:1788587869.316312:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f4c1923800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788587869.316330:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4c1927800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788587869.316334:0:36:0:(genops.c:885:class_export_put()) final put ffff88f49d37e000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788587869.316336:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f49d37e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788587869.316339:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1788587869.316497:0:12973:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88f488106000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788587869.316501:0:12973:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88f488106000 3 00000020:00000080:1.0:1788587869.316508:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4c1923800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1788587869.316511:0:12973:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88f488106000 from lustre-MDT0000 00000020:00000080:2.0:1788587869.316530:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587869.316535:0:12973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788587869.316538:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f48661e800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788587869.316540:0:12973:0:(genops.c:844:class_export_destroy()) destroying export ffff88f48661e800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788587869.316546:0:12973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788587869.316574:0:12973:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788587869.316577:0:12973:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788587869.316580:0:12973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788587869.316583:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587869.316586:0:12973:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788587869.316592:0:12973:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff88f483662800 52de7536-38dc-49e6-9b51-4cdaba805a7b 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788587869.316597:0:12973:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff88f48569cd40) has exports, disconnecting them 00000020:00080000:2.0:1788587869.316601:0:12973:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff88f483662800), last request at 1788587669 00000020:00000080:2.0:1788587869.316614:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca7f92 00000020:00010000:2.0:1788587869.316618:0:12973:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88f483662800: total 0 00000100:00080000:2.0:1788587869.316622:0:12973:0:(import.c:65:import_set_state_nolock()) ffff88f483667000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788587869.316639:0:12973:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88f483662800): rc 0 00000020:00080000:2.0:1788587869.316643:0:12973:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff88f48569cd40) has no exports 00000020:00010000:0.0:1788587869.316665:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88f483662800: total 0 00000100:00100000:2.0:1788587869.316693:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff88f485653800:5834] 0 exiting: rc = 1 00010000:00010000:0.0:1788587869.316700:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88f483662800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788587869.316726:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed4e00/0xa13e120d54ca82e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca82da expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587869.316745:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed4400/0xa13e120d54ca82d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca82cc expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587869.316759:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4c159c400/0xa13e120d54ca84d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca84d2 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587869.316770:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4c159ca00/0xa13e120d54ca84e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca84e0 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587869.316784:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f480031e00/0xa13e120d54ca809c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca8095 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587869.316798:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f481668200/0xa13e120d54ca82a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca82a2 expref: 4 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587869.316811:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4bf77a000/0xa13e120d54ca82b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca82b0 expref: 3 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587869.316825:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4baed5e00/0xa13e120d54ca8327 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13e120d54ca8320 expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587869.316861:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88f483662800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788587869.316881:0:5828:0:(genops.c:885:class_export_put()) final put ffff88f483662800/52de7536-38dc-49e6-9b51-4cdaba805a7b 00010000:00010000:0.0:1788587869.316897:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587869.316909:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587869.316911:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788587869.316917:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f483662800/52de7536-38dc-49e6-9b51-4cdaba805a7b for MGS 00000020:00000080:0.0:1788587869.316938:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f483667000 for MGS 00000100:00100000:1.0:1788587869.317054:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff88f485653c00:5835] 1 exiting: rc = 0 00000100:00100000:1.0:1788587869.317151:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff88f485653600:5836] 2 exiting: rc = 0 00000100:00100000:2.0:1788587869.317186:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317195:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317200:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317207:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317212:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317217:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317223:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317229:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317234:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317240:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317245:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317251:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317265:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317272:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317280:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317287:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317295:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317302:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317309:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317316:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317324:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317335:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317343:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317351:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317358:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317366:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317373:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317381:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317388:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317395:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317415:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317423:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317431:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317438:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317446:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317457:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317468:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317475:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317480:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317486:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317551:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317556:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317561:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317566:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317571:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317576:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317582:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317594:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317600:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317606:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317611:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317616:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317622:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317627:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317633:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317639:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317645:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317650:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317656:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317662:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317667:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317672:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317678:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.317683:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788587869.318467:0:12973:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788587869.318472:0:12973:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788587869.321422:0:12973:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88f381ff0960 - data ffff88f4bffd6ca8/ffff88f4bf581000 00000020:01000000:2.0:1788587869.321552:0:12973:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88f4871eeea0 - data ffff88f4a5832288/ffff88f4871d1c00 00000020:00000080:2.0:1788587869.322187:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca7f76 00000020:00000080:2.0:1788587869.322195:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f48f8cd000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788587869.322249:0:12973:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88f488106000 from MGS, refs=2 00000020:01000004:2.0:1788587869.322253:0:12973:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88f488106000 2 00000020:01000004:2.0:1788587869.322257:0:12973:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88f488106000 from MGS 00000020:00000080:2.0:1788587869.322277:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587869.322284:0:12973:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788587869.322287:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f48f8cd800/MGS 00000020:00000080:2.0:1788587869.322289:0:12973:0:(genops.c:844:class_export_destroy()) destroying export ffff88f48f8cd800/MGS for MGS 00000020:01000000:2.0:1788587869.322296:0:12973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788587869.322350:0:12973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788587869.322353:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587869.322358:0:12973:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788587869.322375:0:12973:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff88f4afd98000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788587869.322381:0:12973:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff88f48709b380) has exports, disconnecting them 00000020:00080000:2.0:1788587869.322385:0:12973:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff88f4afd98000), last request at 1788587670 00000020:00000080:2.0:1788587869.322389:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8041 00000020:00080000:2.0:1788587869.322399:0:12973:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88f4afd98000): rc 0 00000020:00000080:2.0:1788587869.322415:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f4afd98000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788587869.322436:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f48f8cd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788587869.323393:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4afd98000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788587869.336652:0:12973:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788587869.336661:0:12973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788587869.336665:0:12973:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788587869.336672:0:12973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788587869.337003:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587869.337012:0:12973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788587869.337020:0:12973:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88f488106000 1 00000020:00000080:2.0:1788587869.337038:0:12973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca7f68 00000020:00000080:2.0:1788587869.337048:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f48f8cc000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788587869.337263:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4afd9d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788587869.337270:0:36:0:(genops.c:885:class_export_put()) final put ffff88f49d37b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788587869.337273:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f49d37b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788587869.337279:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1788587869.337433:0:12973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788587869.337439:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587869.337443:0:12973:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788587869.337447:0:12973:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff88f4870999c0) has no exports 00000020:00000080:1.0:1788587869.339595:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f48f8cc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788587869.346963:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587869.346977:0:12973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788587869.346983:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f49221d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788587869.346988:0:12973:0:(genops.c:844:class_export_destroy()) destroying export ffff88f49221d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788587869.346995:0:12973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788587869.347134:0:12973:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88f4851db800 00000020:01000000:1.0:1788587869.347158:0:12973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788587869.347162:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587869.347166:0:12973:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788587869.347180:0:12973:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff88f487098000) has no exports 00000100:00100000:1.0:1788587869.347259:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff88f487062600:5843] 2 exiting: rc = 0 00000100:00100000:3.0:1788587869.352049:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff88f4867cda00:5841] 0 exiting: rc = 1 00000100:00100000:2.0:1788587869.352095:0:7276:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff88f4b4fc9600:7276] 3 exiting: rc = 0 00000100:00100000:2.0:1788587869.352180:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff88f487c4f200:5842] 1 exiting: rc = 0 00000100:00100000:2.0:1788587869.352230:0:8471:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff88f4b4c8fc00:8471] 4 exiting: rc = 0 00000100:00100000:0.0:1788587869.353102:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353110:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353116:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353121:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353128:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353134:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353140:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353146:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353152:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353158:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353164:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353169:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353175:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353182:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353189:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353196:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353207:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353215:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353224:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353231:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353239:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353245:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353252:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353260:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353266:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353272:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353280:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353287:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353294:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353315:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353323:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353330:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353337:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353344:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353350:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353359:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353367:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353376:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353383:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353390:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353397:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353415:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353424:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353430:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353439:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353450:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353461:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353467:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353480:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353603:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353609:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353614:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353619:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353624:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353630:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353635:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353640:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353645:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353650:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353656:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353661:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353666:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353671:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.353678:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.363517:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff88f487c4fa00:5845] 1 exiting: rc = 0 00000100:00100000:0.0:1788587869.363679:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff88f487c4f600:5844] 0 exiting: rc = 1 00000100:00100000:0.0:1788587869.363805:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.363814:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.363822:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.363829:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.363835:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364081:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364092:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364098:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364103:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364108:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364114:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364120:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364128:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364132:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364138:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364142:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364147:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364152:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364157:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364162:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364166:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364171:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364176:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364180:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364185:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364190:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364195:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364200:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364204:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364209:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364214:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364219:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364224:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364229:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364249:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364254:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364260:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364264:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364269:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364274:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364279:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364285:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364290:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364295:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364300:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364304:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364310:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364315:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364321:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364326:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364331:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364336:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364341:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364346:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364351:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364356:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364360:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364365:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364371:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364376:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364381:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364386:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364391:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.364396:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.365175:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff88f486702800:5847] 1 exiting: rc = 0 00000100:00100000:3.0:1788587869.368290:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff88f486703e00:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1788587869.368428:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368446:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368454:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368461:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368467:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368486:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368491:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368497:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368503:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368509:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368528:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368536:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368543:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368549:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368555:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368562:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368568:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368574:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368580:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368586:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368592:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368598:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368618:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368625:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368631:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368639:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368648:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368656:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368664:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368672:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368680:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368689:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368698:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368706:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368754:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368763:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368770:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368777:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368785:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368793:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368813:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368821:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368827:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368837:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368871:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.368879:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369090:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369099:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369104:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369110:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369116:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369122:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369128:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369133:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369139:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369144:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369149:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369154:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369173:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369179:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369185:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369190:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369196:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.369210:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.378107:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff88f486703000:5848] 0 exiting: rc = 1 00000100:00100000:3.0:1788587869.383578:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff88f489483c00:5849] 1 exiting: rc = 0 00000100:00100000:1.0:1788587869.385514:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.385525:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.385531:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.385538:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.385546:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.385552:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.385559:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.385567:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.385573:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.385580:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.385587:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.385597:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.385604:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.385610:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386150:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386234:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386244:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386250:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386255:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386260:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386265:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386270:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386275:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386279:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386284:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386289:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386294:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386298:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386303:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386321:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386326:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386331:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386336:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386341:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386347:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386352:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386357:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386361:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386367:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386371:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386376:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386380:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386385:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386391:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386395:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386400:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386416:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386421:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386425:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386430:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386435:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386440:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386445:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386449:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386454:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386458:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386463:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386467:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386471:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386476:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386480:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386484:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386489:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.386494:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.387918:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff88f489482000:5851] 1 exiting: rc = 0 00000100:00100000:1.0:1788587869.388465:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff88f489482800:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1788587869.388580:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388590:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388601:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388610:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388621:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388628:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388642:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388651:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388655:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388660:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388675:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388680:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388685:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388690:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388696:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388701:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388706:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388710:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388715:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388795:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388800:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388805:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388810:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388815:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388820:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388825:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388829:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388834:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388872:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388879:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388885:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388890:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.388894:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389072:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389081:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389088:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389103:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389110:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389122:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389133:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389142:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389149:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389161:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389252:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389258:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389271:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389276:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389281:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389287:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389292:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389297:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389302:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389307:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389312:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389318:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389323:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389328:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389333:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389338:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389344:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389349:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389354:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389359:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389364:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.389990:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff88f489482400:5852] 0 exiting: rc = 1 00000100:00100000:1.0:1788587869.390256:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff88f487900a00:5853] 1 exiting: rc = 0 00000100:00100000:0.0:1788587869.390391:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390397:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390415:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390421:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390426:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390432:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390437:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390442:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390448:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390452:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390458:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390464:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390469:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390475:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390481:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390496:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390501:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390507:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390512:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390517:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390522:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390527:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390532:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390537:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390542:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390547:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390551:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390556:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390560:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390565:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390570:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390574:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390579:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390584:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390590:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390597:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390604:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390610:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390615:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390622:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390628:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390635:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390642:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390650:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390657:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390663:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390670:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390677:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390685:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390691:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390709:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.390716:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.391210:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.391215:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.391221:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.391226:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.391232:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.391237:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.391242:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.391247:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.391252:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.391257:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.391262:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587869.391268:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587869.392252:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff88f487901c00:5854] 0 exiting: rc = 1 00000100:00100000:3.0:1788587869.392328:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff88f487087600:5855] 1 exiting: rc = 0 00000100:00100000:3.0:1788587869.396915:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff88f487087800:5856] 2 exiting: rc = 0 00000100:00100000:1.0:1788587869.398647:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.398657:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.398665:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.398673:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.398681:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.398689:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.398696:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.398704:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.398712:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.398797:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.398810:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.398822:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.398880:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.398888:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.398894:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399087:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399097:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399103:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399109:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399114:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399120:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399125:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399131:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399136:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399141:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399147:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399153:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399158:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399164:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399170:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399176:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399182:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399188:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399204:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399210:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399216:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399234:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399241:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399246:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399252:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399257:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399264:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399269:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399276:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399282:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399287:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399293:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399299:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399305:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399311:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399317:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399323:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399329:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399335:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399340:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399346:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399351:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399357:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399362:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399368:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399373:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399378:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399384:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587869.399389:0:12973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788587869.408300:0:12973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587869.408313:0:12973:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788587869.408320:0:12973:0:(genops.c:885:class_export_put()) final put ffff88f48661e000/MDS_uuid 00000020:00000080:1.0:1788587869.408324:0:12973:0:(genops.c:844:class_export_destroy()) destroying export ffff88f48661e000/MDS_uuid for MDS 00000020:01000000:1.0:1788587869.408340:0:12973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788587869.408478:0:12973:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788587869.640957:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587870.664242:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587871.176069:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587871.176089:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043920896:0@lo:400:kworker.0 00000400:00000100:2.0:1788587871.176141:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875470043920896 offset 0 length 224: 4 00000100:00100000:0.0:1788587871.176235:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043920768:0@lo:400:kworker.0 00000400:00000100:0.0:1788587871.176260:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875470043920768 offset 0 length 224: 4 00000100:00100000:0.0:1788587871.176278:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587871.176284:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043920640:0@lo:400:kworker.0 00000400:00000100:0.0:1788587871.176301:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875470043920640 offset 0 length 224: 4 00010000:00010000:0.0:1788587871.688418:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788587872.152999:0:13124:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788587872.172016:0:13124:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788587872.172064:0:13124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587872.172081:0:13124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587872.172090:0:13124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587872.172110:0:13124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587872.172145:0:13124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788587872.172151:0:13124:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788587872.172176:0:13124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587872.172188:0:13124:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88f382304a80 x1875470043920768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587887 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587872.172380:0:13124:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788587872.172425:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043920768:0@lo:400:kworker.0 00010000:00010000:3.0:1788587872.172526:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587872.172534:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587872.172542:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481539600 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:3.0:1788587872.172545:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587872.172554:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587872.172561:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587872.172567:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788587872.172569:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788587872.172572:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788587872.172606:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587872.172612:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587872.172644:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587872.172662:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481539600/0xa13e120d54ca82cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13e120d54ca82d3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587872.172672:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587872.172674:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587872.172676:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587872.172745:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587872.172758:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043921024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587872.172810:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587872.173762:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043921024 00000100:00100000:1.0:1788587872.173773:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043921024 00000100:00100000:1.0:1788587872.173824:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788587872.173832:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3304:x1875470043921024:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788587872.173860:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788587872 with bad export cookie 11618743937128890258 00000100:00080000:0.0:1788587872.174098:0:13124:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788587872.174120:0:13124:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb47800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788587872.175509:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875470043921152:0@lo:39:umount.0 00000400:00000100:3.0:1788587872.175559:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875470043921152 offset 0 length 224: 4 00000100:00100000:2.0:1788587872.189361:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3304:x1875470043921024:12345-0@lo:103:ldlm_bl.0 Request processed in 15520us (16542us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788587872.189375:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788587872.189490:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.133@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788587872.189496:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88f48661b800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788587872.189500:0:3304:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.133@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788587872.199664:0:3304:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.133@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788587872.199670:0:3304:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788587872.199678:0:3304:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88f382304700 x1875470043920640/t0(0) o400->MGC192.168.206.133@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788587887 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587872.200052:0:3304:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88f4bab64e00 x1875470043921024/t0(0) o103->MGC192.168.206.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788587888 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788587872.200064:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788587872.200066:0:3304:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788587872.200068:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788587872.200071:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88f48661b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587872.200076:0:3304:0:(import.c:545:import_select_connection()) MGC192.168.206.133@tcp: connect to NID 0@lo last attempt 117 00000100:00080000:3.0:1788587872.200086:0:3304:0:(import.c:665:import_select_connection()) MGC192.168.206.133@tcp: import ffff88f48661b800 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:0.0:1788587872.200245:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:52de7536-38dc-49e6-9b51-4cdaba805a7b:3303:1875470043920640:0@lo:400:kworker.0 00000100:00100000:2.0:1788587872.200504:0:3304:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f382307b80 x1875470043921280/t0(0) o250->MGC192.168.206.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587872.200536:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:52de7536-38dc-49e6-9b51-4cdaba805a7b:3304:1875470043921024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587872.200605:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:52de7536-38dc-49e6-9b51-4cdaba805a7b:3301:1875470043921280:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1788587872.200646:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875470043921280 offset 0 length 520: 4 00000001:00100000:2.0:1788587872.252265:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788587872.252274:0:6718:0:(genops.c:885:class_export_put()) final put ffff88f4b487e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788587872.252402:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4b487e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788587872.252526:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4b487c000 for lustre-OST0000 00010000:00010000:0.0:1788587872.714720:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788587873.271615:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788587873.271631:0:7648:0:(genops.c:885:class_export_put()) final put ffff88f381d11800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788587873.271971:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88f381d11800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788587873.272030:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f381d12000 for lustre-OST0001 00010000:00010000:3.0:1788587873.736074:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587874.760519:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587875.784139:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788587876.296117:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 52de7536-38dc-49e6-9b51-4cdaba805a7b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788587876.296130:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 52de7536-38dc-49e6-9b51-4cdaba805a7b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587876.296304:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043921408:0@lo:400:kworker.0 00000400:00000100:3.0:1788587876.296384:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875470043921408 offset 0 length 224: 4 00010000:00010000:3.0:1788587876.810451:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788587877.328407:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) 52de7536-38dc-49e6-9b51-4cdaba805a7b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587877.328418:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) 52de7536-38dc-49e6-9b51-4cdaba805a7b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587877.328546:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587877.328572:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043921536:0@lo:400:kworker.0 00000400:00000100:3.0:1788587877.328647:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875470043921536 offset 0 length 224: 4 00010000:00010000:3.0:1788587877.832552:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587878.857731:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587879.880526:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587880.905713:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587881.930545:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788587882.440704:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) 52de7536-38dc-49e6-9b51-4cdaba805a7b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788587882.440714:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) 52de7536-38dc-49e6-9b51-4cdaba805a7b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587882.440838:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875470043921664:0@lo:400:kworker.0 00000400:00000100:2.0:1788587882.440918:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875470043921664 offset 0 length 224: 4 00000100:00100000:1.0:1788587882.441231:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587872/real 1788587872] req@ffff88f382307b80 x1875470043921280/t0(0) o250->MGC192.168.206.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788587882 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587882.441252:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88f382307b80 x1875470043921280/t0(0) o250->MGC192.168.206.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788587882 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587882.441262:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587872/real 1788587872] req@ffff88f38181fb80 x1875470043921152/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587882 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587882.441272:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88f38181fb80 x1875470043921152/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587882 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587882.441285:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f48661b800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587882.441306:0:3301:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788587882.441310:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:52de7536-38dc-49e6-9b51-4cdaba805a7b:3301:1875470043921280:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1788587882.441316:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb47800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788587882.441325:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875470043921152:0@lo:39:umount.0 00000100:00080000:3.0:1788587882.441377:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) 52de7536-38dc-49e6-9b51-4cdaba805a7b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788587882.441382:0:496:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788587882.441386:0:496:0:(import.c:65:import_set_state_nolock()) ffff88f48661b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587882.441392:0:496:0:(import.c:545:import_select_connection()) MGC192.168.206.133@tcp: connect to NID 0@lo last attempt 319 00000100:00080000:3.0:1788587882.441397:0:496:0:(import.c:630:import_select_connection()) MGC192.168.206.133@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788587882.441404:0:496:0:(import.c:665:import_select_connection()) MGC192.168.206.133@tcp: import ffff88f48661b800 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:3.0:1788587882.441427:0:496:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f4bab67800 x1875470043921792/t0(0) o250->MGC192.168.206.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587882.441435:0:13124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587882.441440:0:13124:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788587882.441444:0:13124:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788587882.442281:0:13124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587882.442304:0:13124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca82e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587882.442311:0:13124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca82e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587882.442317:0:13124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca82e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587882.442352:0:13124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587882.442360:0:13124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca84e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587882.442367:0:13124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca84e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587882.442374:0:13124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca84e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587882.442381:0:13124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca84e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587882.442398:0:13124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788587882.442403:0:13124:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1788587882.442404:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587882.442417:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca82e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788587882.442426:0:13124:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00010000:00010000:3.0:1788587882.442429:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481539400 already unused, calling callback (ffffffffc1d4ec20) 00000020:01000000:0.0:1788587882.442432:0:13124:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788587882.442439:0:13124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:3.0:1788587882.442441:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca82e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788587882.442445:0:13124:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788587882.442452:0:13124:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff88f4af0d8000) has no exports 00010000:00010000:3.0:1788587882.442472:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13e120d54ca82e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788587882.442484:0:13124:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff88f4af0d8000) has no exports 10000000:00010000:3.0:1788587882.442490:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13e120d54ca82e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587882.442500:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788587882.442505:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788587882.442510:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788587882.442531:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88f48661b800 00010000:00010000:3.0:1788587882.442536:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13e120d54ca82e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587882.442554:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481539400/0xa13e120d54ca82da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13e120d54ca82e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587882.442576:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587882.442579:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca84e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587882.442587:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481668400 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:3.0:1788587882.442602:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca84e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587882.442608:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13e120d54ca84e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587882.442614:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13e120d54ca84e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587882.442620:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788587882.442622:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788587882.442624:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788587882.442888:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88f48661b800 00010000:00010000:3.0:1788587882.442893:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13e120d54ca84e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587882.442900:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481668400/0xa13e120d54ca84e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13e120d54ca84e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587882.442918:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587882.442923:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587882.442925:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587882.442939:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788587882.444111:0:13124:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88f48561a8a0 - data ffff88f49d75a948/ffff88f4baaad400 00000020:01000000:0.0:1788587882.444224:0:13124:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88f4af248600 - data ffff88f49d750438/ffff88f4bf7e0800 00000100:00100000:1.0:1788587882.444860:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:52de7536-38dc-49e6-9b51-4cdaba805a7b:3301:1875470043921792:0@lo:250:kworker.0 00000400:00000100:1.0:1788587882.444919:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875470043921792 offset 0 length 520: 4 00100000:10000000:0.0:1788587882.457961:0:13124:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788587882.492639:0:13124:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca80b8 00000020:00000080:3.0:1788587882.492648:0:13124:0:(genops.c:885:class_export_put()) final put ffff88f4bf84c800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788587882.492667:0:13124:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88f4baee9800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788587882.492670:0:13124:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88f4baee9800 2 00000020:01000004:3.0:1788587882.492673:0:13124:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88f4baee9800 from lustre-OST0000 00000020:00000080:3.0:1788587882.492706:0:13124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587882.492716:0:13124:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788587882.492720:0:13124:0:(genops.c:885:class_export_put()) final put ffff88f4bf849800/lustre-OST0000_UUID 00000020:00000080:3.0:1788587882.492723:0:13124:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bf849800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788587882.492748:0:13124:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788587882.492790:0:13124:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788587882.492794:0:13124:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788587882.492798:0:13124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587882.492803:0:13124:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788587882.492810:0:13124:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff88f4bfb43000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788587882.492816:0:13124:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff88f4bfb38000) has exports, disconnecting them 00000020:00080000:3.0:1788587882.492820:0:13124:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff88f4bfb43000), last request at 1788587685 00000020:00000080:3.0:1788587882.492823:0:13124:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca80e2 00000020:00080000:3.0:1788587882.492866:0:13124:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88f4bfb43000): rc 0 00000020:00000080:3.0:1788587882.492871:0:13124:0:(genops.c:885:class_export_put()) final put ffff88f4bfb43000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788587882.493576:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bf84c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788587882.493589:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bfb43000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788587882.494945:0:13124:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788587882.494951:0:13124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788587882.494955:0:13124:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788587882.494962:0:13124:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788587882.495115:0:13124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587882.495124:0:13124:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788587882.495131:0:13124:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88f4baee9800 1 00000020:00000080:2.0:1788587882.495137:0:13124:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8072 00000020:00000080:2.0:1788587882.495145:0:13124:0:(genops.c:885:class_export_put()) final put ffff88f4836aa800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788587882.495151:0:13124:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788587882.495156:0:13124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587882.495160:0:13124:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788587882.495163:0:13124:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff88f48702b380) has no exports 00000020:00000080:0.0:1788587882.495269:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4bfb47800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788587882.495276:0:496:0:(genops.c:885:class_export_put()) final put ffff88f4afd81000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788587882.495279:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4afd81000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788587882.495285:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788587882.495346:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4836aa800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788587882.519679:0:13124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587882.519695:0:13124:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788587882.519700:0:13124:0:(genops.c:885:class_export_put()) final put ffff88f4baeef000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788587882.519704:0:13124:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4baeef000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788587882.519722:0:13124:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788587882.519930:0:13124:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88f4baeea800 00000020:02000400:2.0:1788587882.519974:0:13124:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788587882.956774:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587883.976031:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587885.010625:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788587885.178773:0:13278:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788587885.191278:0:13278:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788587885.191360:0:13278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587885.191375:0:13278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca82a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587885.191383:0:13278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca82a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587885.191390:0:13278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca82a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587885.191416:0:13278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788587885.191422:0:13278:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788587885.191440:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587885.191451:0:13278:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88f382306a00 x1875470043920896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587887 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788587885.191506:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587885.191515:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca82a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587885.191523:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77ac00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:3.0:1788587885.191527:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca82a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587885.191533:0:13278:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88f38181c000 x1875470043921408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587892 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788587885.191538:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13e120d54ca82a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587885.191562:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13e120d54ca82a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587885.191562:0:13278:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88f382304380 x1875470043921536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587893 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788587885.191583:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788587885.191586:0:13278:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88f38181f800 x1875470043921664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587898 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788587885.191588:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788587885.191592:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1788587885.191600:0:13278:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788587885.191607:0:13278:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1788587885.191613:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88f48661b800 00010000:00010000:3.0:1788587885.191619:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13e120d54ca82a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587885.191628:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f4bf77ac00/0xa13e120d54ca82a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13e120d54ca82a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788587885.191630:0:13278:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb0c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788587885.191644:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587885.191647:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587885.191650:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587885.191675:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875470043921920:0@lo:39:umount.0 00000400:00000100:0.0:1788587885.191721:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875470043921920 offset 0 length 224: 4 00000100:00100000:2.0:1788587885.191829:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043921536:0@lo:400:kworker.0 00000100:00100000:2.0:1788587885.191837:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043921408:0@lo:400:kworker.0 00000100:00100000:2.0:1788587885.191897:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875470043921664:0@lo:400:kworker.0 00000100:00100000:1.0:1788587885.192295:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043920896:0@lo:400:kworker.0 00010000:00010000:3.0:1788587886.025236:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587887.048225:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587887.560857:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 52de7536-38dc-49e6-9b51-4cdaba805a7b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587887.560866:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 52de7536-38dc-49e6-9b51-4cdaba805a7b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788587888.072543:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587889.096038:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587890.127369:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587891.144885:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587892.168163:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587892.680514:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 52de7536-38dc-49e6-9b51-4cdaba805a7b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587892.680523:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 52de7536-38dc-49e6-9b51-4cdaba805a7b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788587893.192031:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587894.216083:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587895.241612:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587895.432126:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587885/real 1788587885] req@ffff88f38181f100 x1875470043921920/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587895 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587895.432184:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88f38181f100 x1875470043921920/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587895 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788587895.432215:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4bfb0c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788587895.432257:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875470043921920:0@lo:39:umount.0 00000100:00080000:1.0:1788587895.433159:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587895.433166:0:13278:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788587895.433174:0:13278:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788587895.434592:0:13278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca82b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587895.434613:0:13278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca82b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587895.434622:0:13278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca82b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587895.434629:0:13278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca82b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587895.434666:0:13278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587895.434675:0:13278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca84d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587895.434682:0:13278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca84d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587895.434688:0:13278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca84d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587895.434719:0:13278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13e120d54ca84d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587895.434746:0:13278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788587895.435250:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587895.435263:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca82b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587895.435285:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f481538e00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:3.0:1788587895.435290:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca82b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587895.435301:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13e120d54ca82b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587895.435328:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13e120d54ca82b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587895.435334:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788587895.435337:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788587895.435354:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88f48661b800 00010000:00010000:3.0:1788587895.435358:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13e120d54ca82b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587895.435365:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481538e00/0xa13e120d54ca82b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13e120d54ca82b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587895.435388:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587895.435392:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca84d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587895.435398:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77be00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:3.0:1788587895.435401:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13e120d54ca84d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587895.435408:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13e120d54ca84d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587895.435415:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13e120d54ca84d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587895.435421:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788587895.435423:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788587895.435427:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88f48661b800 00010000:00010000:3.0:1788587895.435436:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13e120d54ca84d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587895.435443:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f4bf77be00/0xa13e120d54ca84d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13e120d54ca84d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587895.435461:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587895.435463:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587895.435465:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587895.436818:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788587895.437975:0:13278:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788587895.437999:0:13278:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788587895.438003:0:13278:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788587895.438053:0:13278:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788587895.438060:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788587895.438075:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587895.438084:0:13278:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788587895.438091:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff88f4bfb3b380) has no exports 00000020:00080000:1.0:1788587895.438129:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff88f4bfb3b380) has no exports 00000020:01000000:1.0:1788587895.446310:0:13278:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88f48561a900 - data ffff88f4bfe77e58/ffff88f4af3c0000 00000020:01000000:1.0:1788587895.446467:0:13278:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88f48364a1e0 - data ffff88f4bff62360/ffff88f4baac5800 00100000:10000000:3.0:1788587895.472903:0:13278:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788587895.536083:0:13278:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8191 00000020:00000080:2.0:1788587895.536101:0:13278:0:(genops.c:885:class_export_put()) final put ffff88f4bf7d9000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788587895.536228:0:13278:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88f4b487a800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788587895.536233:0:13278:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88f4b487a800 2 00000020:01000004:2.0:1788587895.536237:0:13278:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88f4b487a800 from lustre-OST0001 00000020:00000080:2.0:1788587895.536276:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587895.536289:0:13278:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788587895.536292:0:13278:0:(genops.c:885:class_export_put()) final put ffff88f4bf7de000/lustre-OST0001_UUID 00000020:00000080:2.0:1788587895.536296:0:13278:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bf7de000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788587895.536304:0:13278:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788587895.536444:0:13278:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 52de7536-38dc-49e6-9b51-4cdaba805a7b->MGS 00010000:00010000:2.0:1788587895.536463:0:13278:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f480031c00/0xa13e120d54ca8095 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13e120d54ca809c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587895.536477:0:13278:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f480031c00/0xa13e120d54ca8095 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13e120d54ca809c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587895.536485:0:13278:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788587895.536489:0:13278:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788587895.536494:0:13278:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788587895.536515:0:13278:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88f48661b800 00010000:00010000:2.0:1788587895.536523:0:13278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f480031c00/0xa13e120d54ca8095 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13e120d54ca809c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587895.536571:0:13278:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f481668800/0xa13e120d54ca8320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13e120d54ca8327 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587895.536584:0:13278:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f481668800/0xa13e120d54ca8320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13e120d54ca8327 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587895.536591:0:13278:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788587895.536595:0:13278:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788587895.536597:0:13278:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788587895.536614:0:13278:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88f48661b800 00010000:00010000:2.0:1788587895.536619:0:13278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f481668800/0xa13e120d54ca8320 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13e120d54ca8327 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788587895.536647:0:13278:0:(import.c:65:import_set_state_nolock()) ffff88f48661b800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788587895.536654:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788587895.536659:0:13278:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788587895.536662:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788587895.536669:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788587895.537010:0:13278:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88f4bab67800 x1875470043921792/t0(0) o250->MGC192.168.206.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788587897 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788587895.537035:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788587895.537039:0:13278:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1788587895.537551:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:52de7536-38dc-49e6-9b51-4cdaba805a7b:3301:1875470043921792:0@lo:250:kworker.0 10000000:01000000:2.0:1788587895.541585:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788587895.541616:0:13278:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca7f84 00000020:00000080:2.0:1788587895.541634:0:13278:0:(genops.c:885:class_export_put()) final put ffff88f48661f000/52de7536-38dc-49e6-9b51-4cdaba805a7b 00000020:00000080:3.0:1788587895.545743:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bf7d9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788587895.545936:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.133@tcp (flags='') 00000020:00000080:2.0:1788587895.545951:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587895.545980:0:13278:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.133@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788587895.545988:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff88f48709cd40) has no exports 10000000:01000000:2.0:1788587895.546031:0:5838:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788587895.546158:0:13278:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.133@tcp: client import never connected 00000100:00080000:2.0:1788587895.546166:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788587895.546172:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788587895.546177:0:13278:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788587895.546181:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788587895.546246:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587895.546256:0:13278:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.133@tcp (uuid 52de7536-38dc-49e6-9b51-4cdaba805a7b) 00000020:01000000:2.0:1788587895.546279:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788587895.546284:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587895.546290:0:13278:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788587895.546301:0:13278:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff88f4bfb0d000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788587895.546308:0:13278:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff88f48569b380) has exports, disconnecting them 00000020:00080000:2.0:1788587895.546315:0:13278:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff88f4bfb0d000), last request at 1788587702 00000020:00000080:2.0:1788587895.546322:0:13278:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca81bb 00000020:00080000:2.0:1788587895.546346:0:13278:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88f4bfb0d000): rc 0 00000020:00000080:2.0:1788587895.546353:0:13278:0:(genops.c:885:class_export_put()) final put ffff88f4bfb0d000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788587895.553471:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f48661f000/52de7536-38dc-49e6-9b51-4cdaba805a7b for MGC192.168.206.133@tcp 00000020:00000080:3.0:1788587895.553498:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f48661b800 for MGC192.168.206.133@tcp 00000020:00000080:3.0:1788587895.553512:0:496:0:(genops.c:885:class_export_put()) final put ffff88f48661a800/52de7536-38dc-49e6-9b51-4cdaba805a7b 00000020:00000080:3.0:1788587895.553515:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f48661a800/52de7536-38dc-49e6-9b51-4cdaba805a7b for MGC192.168.206.133@tcp 00000020:01000000:3.0:1788587895.553521:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.133@tcp (52de7536-38dc-49e6-9b51-4cdaba805a7b) 00000020:00000080:3.0:1788587895.554106:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bfb0d000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788587895.558130:0:13278:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788587895.558144:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788587895.558151:0:13278:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788587895.558160:0:13278:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788587895.558256:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1788587895.558658:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88f4bfb0c800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788587895.559331:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1788587895.559811:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff88f49fabf200:5823] 0 exiting: rc = 1 00000100:00100000:2.0:1788587895.560354:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff88f488b8be00:5824] 1 exiting: rc = 0 00000100:00100000:3.0:1788587895.561367:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.561780:0:6708:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff88f48391a400:6708] 3 exiting: rc = 0 00000100:00100000:0.0:1788587895.562238:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff88f4883bca00:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1788587895.562590:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff88f4883bd400:5825] 0 exiting: rc = 1 00000100:00100000:2.0:1788587895.562656:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff88f4883bd800:5827] 2 exiting: rc = 0 00000100:00100000:3.0:1788587895.563420:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563433:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563442:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563448:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563454:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563461:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563467:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563489:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563495:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563500:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563506:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563512:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563518:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563525:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563531:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563538:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563546:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563551:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563557:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563563:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563569:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563574:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563580:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563586:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563591:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563597:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563604:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563610:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563616:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563621:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563627:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563633:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563638:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563645:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563651:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563656:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563661:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563666:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563671:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563678:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563683:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563687:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563700:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563706:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563711:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563716:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563721:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563728:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563733:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563740:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563745:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563752:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563757:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563764:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563769:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563777:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563784:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563789:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563794:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563799:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563804:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563811:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563816:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.563821:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788587895.564814:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587895.564827:0:13278:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788587895.564834:0:13278:0:(genops.c:885:class_export_put()) final put ffff88f4b487a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788587895.564867:0:13278:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4b487a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788587895.564874:0:13278:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788587895.564928:0:13278:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88f4b487a800 1 00000020:00000080:3.0:1788587895.564939:0:13278:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13e120d54ca8160 00000020:00000080:3.0:1788587895.564949:0:13278:0:(genops.c:885:class_export_put()) final put ffff88f4bf849000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788587895.564981:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788587895.564990:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587895.564997:0:13278:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788587895.565003:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff88f485698000) has no exports 00000020:00000080:1.0:1788587895.566042:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4bf849000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788587895.593882:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587895.593907:0:13278:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788587895.593914:0:13278:0:(genops.c:885:class_export_put()) final put ffff88f4b487c800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788587895.593920:0:13278:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4b487c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788587895.593933:0:13278:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788587895.594159:0:13278:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88f4b4878800 00000020:01000000:1.0:1788587895.594190:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788587895.594195:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587895.594212:0:13278:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788587895.594217:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff88f4af0dcd40) has no exports 00000020:00000080:1.0:1788587895.594256:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587895.594263:0:13278:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788587895.594276:0:13278:0:(genops.c:885:class_export_put()) final put ffff88f4836af000/OSS_uuid 00000020:00000080:1.0:1788587895.594279:0:13278:0:(genops.c:844:class_export_destroy()) destroying export ffff88f4836af000/OSS_uuid for OSS 00000020:01000000:1.0:1788587895.594283:0:13278:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788587895.597515:0:5837:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788587895.597770:0:9214:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff88f4bfc4d000:9214] 3 exiting: rc = 0 00000100:00100000:0.0:1788587895.597883:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff88f4af0d3600:6693] 0 exiting: rc = 1 00000100:00100000:0.0:1788587895.597941:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff88f4bacfe000:6694] 1 exiting: rc = 0 00000100:00100000:3.0:1788587895.598241:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff88f4bacff000:6695] 2 exiting: rc = 0 00000100:00100000:1.0:1788587895.598424:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598435:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598442:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598465:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598473:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598479:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598485:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598490:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598496:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598501:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598506:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598512:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598517:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598523:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598528:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598533:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598539:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598546:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598554:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598560:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598566:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598571:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598577:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598583:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598589:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598594:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598599:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598605:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598621:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598627:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598632:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598638:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598643:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598651:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598657:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598662:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598667:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598673:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598679:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598685:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598694:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598702:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598711:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598721:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598729:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598738:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598747:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598755:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598789:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598799:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598808:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598818:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598827:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598838:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598897:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598907:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598916:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598925:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598934:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598944:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598953:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598961:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598970:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.598997:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.600495:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff88f4af0d3a00:6697] 1 exiting: rc = 0 00000100:00100000:0.0:1788587895.600807:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff88f4bacff200:6696] 0 exiting: rc = 1 00000100:00100000:1.0:1788587895.601077:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601092:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601099:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601105:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601111:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601117:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601124:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601129:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601135:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601141:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601146:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601152:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601158:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601164:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601169:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601174:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601180:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601185:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601190:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601195:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601201:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601207:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601213:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601220:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601225:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601232:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601237:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601243:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601249:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601254:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601259:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601274:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601281:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601287:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601311:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601316:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601322:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601328:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601334:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601340:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601347:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601353:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601358:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601362:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601368:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601373:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601378:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601383:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601388:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601394:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601400:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601405:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601411:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601416:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601423:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601428:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601434:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601439:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601445:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601450:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601456:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601462:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601468:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.601474:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.607326:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff88f489401e00:6700] 2 exiting: rc = 0 00000100:00100000:3.0:1788587895.607587:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff88f4af253400:6699] 1 exiting: rc = 0 00000100:00100000:2.0:1788587895.608164:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff88f4af0d3800:6698] 0 exiting: rc = 1 00000100:00100000:1.0:1788587895.609515:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609526:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609533:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609539:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609545:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609568:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609575:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609581:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609588:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609593:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609599:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609605:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609612:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609617:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609623:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609630:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609636:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609643:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609649:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609655:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609661:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609666:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609672:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609678:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609701:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609709:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609714:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609720:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609727:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609733:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609739:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609746:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609752:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609759:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609766:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609775:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609781:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609788:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609794:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609802:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609817:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609824:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609831:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609837:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609970:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609977:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609983:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609990:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.609996:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610003:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610009:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610015:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610022:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610028:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610046:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610068:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610076:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610082:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610088:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610094:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610100:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610106:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610112:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.610126:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.616838:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff88f489401400:6701] 0 exiting: rc = 1 00000100:00100000:0.0:1788587895.617159:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff88f4c14a7400:6702] 1 exiting: rc = 0 00000100:00100000:3.0:1788587895.617340:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617350:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617355:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617361:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617367:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617374:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617379:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617385:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617391:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617396:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617402:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617407:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617413:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617419:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617424:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617429:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617435:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617440:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617446:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617451:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617457:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617464:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617470:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617476:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617482:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617488:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617494:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617499:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617504:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617547:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617555:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617563:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617569:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617574:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617580:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617587:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617593:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617602:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617608:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617615:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617621:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617631:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617639:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617648:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617657:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617667:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617677:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617706:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617717:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617727:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617735:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617746:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617755:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617761:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617768:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617774:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617780:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617785:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617790:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617795:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617801:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617806:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617811:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.617818:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587895.618717:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff88f4bacfe600:6703] 0 exiting: rc = 1 00000100:00100000:0.0:1788587895.621500:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff88f4c14a6800:6704] 1 exiting: rc = 0 00000100:00100000:1.0:1788587895.621729:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621742:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621752:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621763:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621771:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621778:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621785:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621793:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621799:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621806:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621813:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621839:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621921:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621932:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621943:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621985:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.621999:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622009:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622020:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622034:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622050:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622060:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622074:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622089:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622099:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622107:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622114:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622139:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622146:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622153:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622160:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622167:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622173:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622181:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622187:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622193:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622199:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622206:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622213:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622233:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622241:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622247:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622253:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622261:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622279:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622285:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622300:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622307:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622313:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622318:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622325:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622347:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622355:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622361:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622367:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622377:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622384:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622390:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622397:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622405:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622412:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622418:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622424:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587895.622430:0:13278:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788587895.633762:0:13278:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788587911.757399:0:13894:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg633-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788587919.965772:0:14357:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788587919.965777:0:14357:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788587919.965929:0:14357:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88f381d1d800 00000020:01000004:3.0:1788587919.965948:0:14357:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788587919.965956:0:14357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788587919.965970:0:14357:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff88f48569b380) 00000020:00000080:3.0:1788587919.965983:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788587919.999412:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788587920.013833:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788587920.014882:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 384: rc = 0 00100000:10000000:2.0:1788587920.015015:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 384: rc = 0 00100000:10000000:2.0:1788587920.015123:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 384: rc = 0 00100000:10000000:2.0:1788587920.015382:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788587920.015458:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 384: rc = 0 00100000:10000000:2.0:1788587920.015559:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 384: rc = 0 00100000:10000000:3.0:1788587920.016600:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 384: rc = 0 00100000:10000000:3.0:1788587920.017561:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 386: rc = 0 00100000:10000000:3.0:1788587920.019279:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 524: rc = 0 00100000:10000000:3.0:1788587920.019389:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 524: rc = 0 00100000:10000000:3.0:1788587920.023640:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 366: rc = 0 00100000:10000000:3.0:1788587920.025962:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 366: rc = 0 00100000:10000000:3.0:1788587920.026348:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 366: rc = 0 00100000:10000000:3.0:1788587920.026612:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 366: rc = 0 00100000:10000000:3.0:1788587920.027109:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 366: rc = 0 00100000:10000000:3.0:1788587920.027367:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 366: rc = 0 00100000:10000000:3.0:1788587920.027626:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 366: rc = 0 00100000:10000000:3.0:1788587920.028193:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 366: rc = 0 00100000:10000000:3.0:1788587920.028451:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 366: rc = 0 00100000:10000000:3.0:1788587920.028945:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 366: rc = 0 00100000:10000000:3.0:1788587920.029302:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 366: rc = 0 00100000:10000000:3.0:1788587920.029994:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 366: rc = 0 00100000:10000000:3.0:1788587920.031430:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 119: rc = 0 00100000:10000000:3.0:1788587920.032154:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 119: rc = 0 00100000:10000000:3.0:1788587920.032418:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 119: rc = 0 00100000:10000000:3.0:1788587920.032979:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 119: rc = 0 00100000:10000000:3.0:1788587920.033241:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 119: rc = 0 00100000:10000000:3.0:1788587920.033478:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 119: rc = 0 00100000:10000000:3.0:1788587920.033811:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 119: rc = 0 00100000:10000000:3.0:1788587920.034273:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 119: rc = 0 00100000:10000000:3.0:1788587920.034523:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 119: rc = 0 00100000:10000000:3.0:1788587920.034883:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 119: rc = 0 00100000:10000000:3.0:1788587920.035128:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 119: rc = 0 00100000:10000000:3.0:1788587920.035411:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 119: rc = 0 00100000:10000000:3.0:1788587920.035739:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 119: rc = 0 00100000:10000000:3.0:1788587920.036092:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 119: rc = 0 00100000:10000000:3.0:1788587920.036358:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 119: rc = 0 00100000:10000000:3.0:1788587920.036617:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 119: rc = 0 00100000:10000000:3.0:1788587920.040043:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 119: rc = 0 00100000:10000000:3.0:1788587920.040336:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 119: rc = 0 00100000:10000000:3.0:1788587920.040587:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 119: rc = 0 00100000:10000000:3.0:1788587920.041452:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 119: rc = 0 00100000:10000000:3.0:1788587920.042026:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 119: rc = 0 00100000:10000000:3.0:1788587920.042295:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 119: rc = 0 00100000:10000000:3.0:1788587920.043205:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 119: rc = 0 00100000:10000000:3.0:1788587920.043787:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 119: rc = 0 00100000:10000000:3.0:1788587920.044073:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 119: rc = 0 00100000:10000000:3.0:1788587920.044355:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 119: rc = 0 00100000:10000000:3.0:1788587920.044691:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 119: rc = 0 00100000:10000000:3.0:1788587920.045004:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 119: rc = 0 00100000:10000000:3.0:1788587920.045287:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 119: rc = 0 00100000:10000000:3.0:1788587920.045552:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 119: rc = 0 00100000:10000000:3.0:1788587920.045807:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 119: rc = 0 00100000:10000000:3.0:1788587920.046112:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 119: rc = 0 00100000:10000000:3.0:1788587920.046479:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 530: rc = 0 00100000:10000000:3.0:1788587920.047029:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788587920.052174:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 525: rc = 0 00100000:10000000:2.0:1788587920.052500:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788587920.052573:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 525: rc = 0 00100000:10000000:2.0:1788587920.052871:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788587920.052944:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 525: rc = 0 00100000:10000000:2.0:1788587920.053297:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788587920.053366:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 647: rc = 0 00100000:10000000:2.0:1788587920.053558:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788587920.053627:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 647: rc = 0 00100000:10000000:2.0:1788587920.055216:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788587920.055303:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 647: rc = 0 00000020:00000080:2.0:1788587920.056018:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788587920.056027:0:14357:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788587920.056038:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13e120d54ca9285 00000020:01000004:2.0:1788587920.056045:0:14357:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788587920.056049:0:14357:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788587920.056054:0:14357:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88f381d1d800 from MGS 00000020:01000004:2.0:1788587920.056057:0:14357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788587920.056068:0:14357:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff88f4af0db380) 00000020:00000080:2.0:1788587920.056077:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788587920.056134:0:14357:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88f381d1d800 from MGS, refs=2 00080000:01000000:2.0:1788587920.056151:0:14357:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788587920.056157:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13e120d54ca9293 00000100:00100000:2.0:1788587920.056259:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788587920.056377:0:14357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788587920.056383:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788587920.057058:0:14357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788587920.057066:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788587920.057641:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587920.058082:0:14357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788587920.058088:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788587920.058812:0:14357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788587920.058820:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788587920.059132:0:14357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788587920.059214:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788587920.060002:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587920.060006:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587920.060008:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587920.060220:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587920.060223:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587920.060224:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587920.061183:0:14357:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788587920.064021:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788587920.073944:0:14357:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788587920.073962:0:14357:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788587920.073965:0:14357:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788587920.075818:0:14366:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788587920.075967:0:14357:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788587920.076063:0:14357:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788587920.076527:0:14357:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788587920.076906:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587920.077060:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788587920.077066:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788587920.078657:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788587920.078667:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788587920.082549:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788587920.082560:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788587920.083605:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788587920.083627:0:14357:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.133@tcp' 00000020:01000004:1.0:1788587920.083629:0:14357:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788587920.083670:0:14357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.133@tcp (typ=mgc) 00000020:00000080:1.0:1788587920.083681:0:14357:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.133@tcp (ffff88f4870299c0) 00000020:00000080:1.0:1788587920.083696:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788587920.083767:0:14357:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88f4baa32000@MGC192.168.206.133@tcp: add connection 192.168.206.133@tcp at head 00010000:00010000:1.0:1788587920.084010:0:14357:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.133@tcp-0 is initialized 00000040:01000000:1.0:1788587920.084017:0:14357:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.133@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788587920.086949:0:14371:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788587920.087656:0:14373:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788587920.087698:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.133@tcp (uuid 475e03e7-2028-419a-a63d-caf8ec05d538) 00000020:00000080:0.0:1788587920.087721:0:14357:0:(genops.c:1385:class_connect()) connect: client 475e03e7-2028-419a-a63d-caf8ec05d538, cookie 0xa13e120d54ca92a1 00000100:00080000:0.0:1788587920.087733:0:14357:0:(import.c:545:import_select_connection()) MGC192.168.206.133@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788587920.087739:0:14357:0:(import.c:665:import_select_connection()) MGC192.168.206.133@tcp: import ffff88f4baa32000 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:0.0:1788587920.087770:0:14357:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f38181f100 x1875470043922048/t0(0) o250->MGC192.168.206.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587920.087797:0:14357:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 475e03e7-2028-419a-a63d-caf8ec05d538->MGS 00000020:01000004:0.0:1788587920.087828:0:14357:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788587920.087862:0:14357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788587920.087875:0:14357:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff88f4bfb38000) 00000020:00000080:0.0:1788587920.087887:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788587920.090549:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:475e03e7-2028-419a-a63d-caf8ec05d538:3301:1875470043922048:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788587920.090620:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587920.090706:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043922048 00000100:00100000:3.0:1788587920.090714:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043922048 00000100:00100000:3.0:1788587920.090745:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587920.090751:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1875470043922048:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788587920.090776:0:14367:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 475e03e7-2028-419a-a63d-caf8ec05d538@0@lo t0 exp 0000000000000000 cur 367 last 0 00000020:00000080:3.0:1788587920.090812:0:14367:0:(genops.c:1385:class_connect()) connect: client 475e03e7-2028-419a-a63d-caf8ec05d538, cookie 0xa13e120d54ca92af 00000100:00080000:3.0:1788587920.092109:0:14367:0:(import.c:65:import_set_state_nolock()) ffff88f381d1e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587920.092205:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+5:3301:x1875470043922048:12345-0@lo:250:mount.lustre.0 Request processed in 1450us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587920.092216:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587920.093087:0:3301:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.133@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788587920.093097:0:3301:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.206.133@tcp: connect to target with instance 0 00000100:00080000:3.0:1788587920.093105:0:3301:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.206.133@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788587920.093110:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788587920.093113:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4baa32000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788587920.093116:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788587920.093125:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788587920.093130:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:475e03e7-2028-419a-a63d-caf8ec05d538:3301:1875470043922048:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788587920.108998:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587920.109208:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788587920.109214:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788587920.115428:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788587920.115447:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788587920.117503:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788587920.117518:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788587920.122397:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587920.122587:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788587920.122593:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788587920.123256:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788587920.123264:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788587920.168188:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587920.168404:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788587920.168411:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788587920.170979:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788587920.170994:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788587920.173257:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587920.173524:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788587920.173531:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788587920.174976:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788587920.174992:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788587920.181810:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587920.182103:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788587920.182110:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788587920.185638:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788587920.185652:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788587920.186347:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587920.186516:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788587920.186521:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788587920.187196:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788587920.187204:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788587920.206173:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587920.206446:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788587920.206453:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788587920.209464:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788587920.209482:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788587920.211000:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788587920.211013:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788587920.217084:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788587920.217110:0:14357:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788587920.217116:0:14357:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.133@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788587920.217258:0:14357:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.133@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788587920.217293:0:14357:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.133@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788587920.217297:0:14357:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788587920.217299:0:14357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788587920.217300:0:14357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587920.217301:0:14357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587920.217302:0:14357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587920.217303:0:14357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587920.217305:0:14357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788587920.217306:0:14357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788587920.217308:0:14357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587920.217309:0:14357:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788587920.217311:0:14357:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788587920.217313:0:14357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788587920.217314:0:14357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788587920.217315:0:14357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587920.217316:0:14357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587920.217317:0:14357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587920.217318:0:14357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587920.217319:0:14357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788587920.217320:0:14357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788587920.217325:0:14357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587920.217326:0:14357:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788587920.217360:0:14357:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788587920.217379:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043922176:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788587920.217446:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587920.217494:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4971c0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587920.217667:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043922176 00000100:00100000:3.0:1788587920.217675:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043922176 00000100:00100000:3.0:1788587920.217764:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587920.217774:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+5:14357:x1875470043922176:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788587920.217819:0:14370:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788587920.217822:0:14370:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788587920.217825:0:14370:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788587920.221575:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788587920.222014:0:14370:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788587920.225892:0:14391:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788587920.225901:0:14391:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788587920.225903:0:14391:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788587920.225948:0:14391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788587920.227942:0:14370:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788587920.227954:0:14370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788587920.244958:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+5:14357:x1875470043922176:12345-0@lo:253:mount.lustre.0 Request processed in 27176us (27501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587920.244977:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587920.246169:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043922176:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788587920.246187:0:14357:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788587920.246190:0:14357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788587920.246192:0:14357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788587920.246193:0:14357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587920.246195:0:14357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587920.246196:0:14357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587920.246197:0:14357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587920.246199:0:14357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788587920.246200:0:14357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788587920.246202:0:14357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587920.246203:0:14357:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788587920.246231:0:14357:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88f381d1d800 from lustre-MDT0000 10000000:01000000:0.0:1788587920.246437:0:14357:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788587920.246441:0:14357:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788587920.246446:0:14357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88f4870299c0 10000000:01000000:0.0:1788587920.246450:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587920.246460:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88f4870299c0 from 1 10000000:01000000:0.0:1788587920.246463:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788587920.246507:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77a400/0xa13e120d54ca92b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587920.246518:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4bf77a400/0xa13e120d54ca92b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587920.246527:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4bf77a400/0xa13e120d54ca92b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587920.246549:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043922304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587920.246612:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587920.246666:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48341cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587920.246788:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043922304 00000100:00100000:3.0:1788587920.246795:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043922304 00000100:00100000:3.0:1788587920.246870:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587920.246957:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+5:14357:x1875470043922304:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587920.246971:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587920.246985:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f480031000/0xa13e120d54ca92bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca92b6 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.247007:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f480031000/0xa13e120d54ca92bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca92b6 expref: 6 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.247017:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f480031000/0xa13e120d54ca92bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca92b6 expref: 6 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.247026:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031000, rc 0) 00000100:00100000:3.0:1788587920.247068:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+6:14357:x1875470043922304:12345-0@lo:101:mount.lustre.0 Request processed in 116us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587920.247092:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788587920.248279:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043922304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587920.248301:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4bf77a400/0xa13e120d54ca92b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92bd expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587920.248312:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4bf77a400/0xa13e120d54ca92b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca92bd expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587920.248384:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043922432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587920.248426:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587920.248465:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4971c0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587920.248720:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043922432 00000100:00100000:2.0:1788587920.248726:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043922432 00000100:00100000:2.0:1788587920.248763:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587920.248771:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+6:14357:x1875470043922432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587920.249008:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+6:14357:x1875470043922432:12345-0@lo:501:mount.lustre.0 Request processed in 237us (581us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788587920.249016:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587920.250005:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043922432:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788587920.250047:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788587920.250073:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77a400/0xa13e120d54ca92b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92bd expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587920.250083:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4bf77a400/0xa13e120d54ca92b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92bd expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587920.250092:0:14357:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88f381d1d800 10000000:01000000:1.0:1788587920.250097:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788587920.250102:0:14357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88f381d1d800 10000000:01000000:1.0:1788587920.250105:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788587920.250108:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88f381d1d800 from 1 10000000:01000000:1.0:1788587920.250110:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788587920.250151:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4856c1000/0xa13e120d54ca92c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587920.250159:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4856c1000/0xa13e120d54ca92c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587920.250168:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4856c1000/0xa13e120d54ca92c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587920.250185:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043922560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788587920.250227:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587920.250797:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043922560 00000100:00100000:0.0:1788587920.250805:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043922560 00000100:00100000:0.0:1788587920.250947:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587920.250967:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+6:14357:x1875470043922560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587920.250980:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587920.250994:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bf77a800/0xa13e120d54ca92cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca92c4 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587920.251018:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bf77a800/0xa13e120d54ca92cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca92c4 expref: 7 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587920.251028:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bf77a800/0xa13e120d54ca92cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca92c4 expref: 7 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587920.251037:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a800, rc 0) 00000100:00100000:0.0:1788587920.251077:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+7:14357:x1875470043922560:12345-0@lo:101:mount.lustre.0 Request processed in 113us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587920.251084:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587920.252352:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4971c0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587920.252386:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043922560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587920.252408:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4856c1000/0xa13e120d54ca92c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92cb expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587920.252419:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4856c1000/0xa13e120d54ca92c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca92cb expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587920.252451:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788587920.252470:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4856c1000/0xa13e120d54ca92c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92cb expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587920.252478:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4856c1000/0xa13e120d54ca92c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92cb expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587920.252485:0:14357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788587920.252489:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788587920.252495:0:14357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88f381d1d800 10000000:01000000:1.0:1788587920.252497:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788587920.252501:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788587920.252504:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788587920.252529:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4856c1a00/0xa13e120d54ca92d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587920.252536:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4856c1a00/0xa13e120d54ca92d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587920.252545:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4856c1a00/0xa13e120d54ca92d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587920.252564:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043922688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788587920.252608:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587920.253872:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4971c0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587920.253876:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043922688 00000100:00100000:2.0:1788587920.253887:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043922688 00000100:00100000:2.0:1788587920.253944:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587920.253954:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+7:14357:x1875470043922688:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587920.253979:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587920.253997:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c159c400/0xa13e120d54ca92d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca92d2 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.254018:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159c400/0xa13e120d54ca92d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca92d2 expref: 8 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.254028:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c159c400/0xa13e120d54ca92d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca92d2 expref: 8 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.254037:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159c400, rc 0) 00000100:00100000:2.0:1788587920.254123:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+8:14357:x1875470043922688:12345-0@lo:101:mount.lustre.0 Request processed in 170us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587920.254129:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587920.254174:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043922688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587920.254190:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4856c1a00/0xa13e120d54ca92d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92d9 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587920.254209:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4856c1a00/0xa13e120d54ca92d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca92d9 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587920.254280:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043922816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587920.254310:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587920.254416:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4971c0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587920.258366:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043922816 00000100:00100000:3.0:1788587920.258383:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043922816 00000100:00100000:3.0:1788587920.258460:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587920.258472:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+8:14357:x1875470043922816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587920.258966:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+9:14357:x1875470043922816:12345-0@lo:501:mount.lustre.0 Request processed in 496us (4654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587920.258974:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587920.259488:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043922816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587920.259569:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382304380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043922944:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587920.259643:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587920.259684:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4badc0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788587920.260835:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043922944 00000100:00100000:3.0:1788587920.260865:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043922944 00000100:00100000:3.0:1788587920.261220:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587920.261231:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+9:14357:x1875470043922944:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587920.265555:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+9:14357:x1875470043922944:12345-0@lo:503:mount.lustre.0 Request processed in 4318us (5904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587920.265569:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587920.265670:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382304380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043922944:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587920.270501:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382304380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:475e03e7-2028-419a-a63d-caf8ec05d538:14392:1875470043923072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587920.270600:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587920.270649:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043923072 00000100:00100000:2.0:1788587920.270651:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4badc0780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587920.270656:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043923072 00000100:00100000:3.0:1788587920.270708:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587920.270718:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+9:14392:x1875470043923072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587920.271079:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+9:14392:x1875470043923072:12345-0@lo:502:llog_process_th.0 Request processed in 363us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587920.271087:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587920.271244:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382304380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:475e03e7-2028-419a-a63d-caf8ec05d538:14392:1875470043923072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788587920.271281:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587920.271292:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587920.271295:0:14392:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788587920.271301:0:14392:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788587920.271304:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788587920.271319:0:14392:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff88f4bfb399c0) 00000020:00000080:0.0:1788587920.271339:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788587920.271345:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788587920.271406:0:14392:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788587920.271413:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13e120d54ca92e7 00000020:00000080:0.0:1788587920.271612:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788587920.271617:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587920.271628:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587920.271638:0:14392:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788587920.271643:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587920.271647:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587920.271648:0:14392:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788587920.271652:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788587920.271659:0:14392:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff88f4bfb3cd40) 00000020:00000080:0.0:1788587920.271670:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788587920.271675:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788587920.271676:0:14392:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788587920.271679:0:14392:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788587920.271685:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788587920.271741:0:14392:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88f381d1d800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788587920.271755:0:14392:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff88f4bfb3b380) 00000020:00000080:0.0:1788587920.271764:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788587920.271814:0:14392:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788587920.271820:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13e120d54ca92fc 00000020:00000080:0.0:1788587920.271941:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788587920.271948:0:14392:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788587920.271953:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa13e120d54ca9303 00080000:01000000:0.0:1788587920.271958:0:14392:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788587920.271962:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13e120d54ca930a 00010000:00010000:1.0:1788587920.358462:0:14392:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788587920.359242:0:14392:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1788587920.359468:0:14392:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788587920.360098:0:14392:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff88f48702cd40) 00000020:00000080:1.0:1788587920.360116:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788587920.360188:0:14392:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788587920.360195:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13e120d54ca9318 00000020:00000080:2.0:1788587920.369826:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788587920.374474:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa13e120d54ca931f 00000020:00000080:2.0:1788587920.375050:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788587920.375062:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587920.375074:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587920.375076:0:14392:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788587920.375080:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587920.375220:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587920.375223:0:14392:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788587920.375229:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788587920.375262:0:14392:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788587920.375276:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587920.375279:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587920.375280:0:14392:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788587920.375283:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788587920.375285:0:14392:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788587920.375286:0:14392:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587920.375288:0:14392:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587920.375289:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788587920.375291:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587920.375292:0:14392:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788587920.375294:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788587920.375298:0:14392:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788587920.375300:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587920.375301:0:14392:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788587920.375304:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788587920.375309:0:14392:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.133@tcp to nid 0x20000c0a8ce85 (192.168.206.133@tcp) 00000020:01000000:2.0:1788587920.375333:0:14392:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788587920.375336:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788587920.375350:0:14392:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff88f4af0d99c0) 00000020:00000080:2.0:1788587920.375367:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788587920.375374:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788587920.375421:0:14392:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788587920.375426:0:14392:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788587920.375432:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13e120d54ca932d 00010000:00080000:2.0:1788587920.375460:0:14392:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88f4afd98800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.133@tcp at head 00010000:00010000:2.0:1788587920.375991:0:14392:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788587920.376513:0:14392:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788587920.376555:0:14392:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788587920.389500:0:14392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587920.389583:0:14392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788587920.390576:0:14392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788587920.391186:0:14396:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788587920.391192:0:14396:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788587920.392355:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587920.392371:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788587920.392406:0:14392:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788587920.392426:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13e120d54ca9334 00000100:00080000:2.0:1788587920.392435:0:14392:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788587920.392441:0:14392:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88f4afd98800 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:2.0:1788587920.392477:0:14392:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f382305f80 x1875470043923200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587920.392508:0:14392:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788587920.392626:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043923200:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788587920.392700:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875470043923200 offset 0 length 520: 4 00000020:01000000:2.0:1788587920.392816:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587920.392820:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587920.392822:0:14392:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788587920.392825:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788587920.392827:0:14392:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788587920.392828:0:14392:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587920.392829:0:14392:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587920.392831:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788587920.392833:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587920.392834:0:14392:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788587920.392836:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788587920.392839:0:14392:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788587920.392862:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587920.392864:0:14392:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788587920.392867:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788587920.392871:0:14392:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.133@tcp to nid 0x20000c0a8ce85 (192.168.206.133@tcp) 00000020:01000000:2.0:1788587920.392904:0:14392:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788587920.392906:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788587920.392923:0:14392:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff88f4af0dcd40) 00000020:00000080:2.0:1788587920.392934:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788587920.392939:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788587920.392990:0:14392:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788587920.392997:0:14392:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788587920.393002:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13e120d54ca9342 00010000:00080000:2.0:1788587920.393027:0:14392:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88f48661c000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.133@tcp at head 00010000:00010000:2.0:1788587920.393249:0:14392:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788587920.393426:0:14392:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788587920.393450:0:14392:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788587920.394127:0:14392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587920.394207:0:14392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788587920.394290:0:14392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788587920.398612:0:14398:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788587920.398619:0:14398:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788587920.399541:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788587920.399553:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788587920.399585:0:14392:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788587920.399604:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13e120d54ca9349 00000100:00080000:0.0:1788587920.399614:0:14392:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788587920.399620:0:14392:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88f48661c000 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:0.0:1788587920.399666:0:14392:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f38181ed80 x1875470043923328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587920.399706:0:14392:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788587920.399759:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587920.399763:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587920.399765:0:14392:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788587920.399768:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587920.399771:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587920.399773:0:14392:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788587920.399775:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788587920.399777:0:14392:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788587920.399779:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587920.399781:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587920.399782:0:14392:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788587920.399785:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587920.399787:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587920.399788:0:14392:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788587920.399791:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788587920.399829:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:475e03e7-2028-419a-a63d-caf8ec05d538:14392:1875470043923456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587920.400069:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587920.400109:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043923456 00000100:00100000:0.0:1788587920.400115:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043923456 00000100:00100000:0.0:1788587920.400159:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788587920.400169:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+9:14392:x1875470043923456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587920.400393:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+9:14392:x1875470043923456:12345-0@lo:502:llog_process_th.0 Request processed in 225us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587920.400400:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788587920.400445:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48341cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587920.400465:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:475e03e7-2028-419a-a63d-caf8ec05d538:14392:1875470043923456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788587920.400490:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587920.400499:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587920.400500:0:14392:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788587920.400504:0:14392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:1.0:1788587920.400668:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043923328:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788587920.400699:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875470043923328 offset 0 length 520: 4 00000020:01000000:3.0:1788587920.401019:0:14357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788587920.401044:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788587920.401065:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4856c1a00/0xa13e120d54ca92d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92d9 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.401075:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4856c1a00/0xa13e120d54ca92d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92d9 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587920.401083:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88f381d1d800 from 1 10000000:01000000:3.0:1788587920.401086:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788587920.401113:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.401120:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.401128:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587920.401156:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043923584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587920.401187:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587920.401217:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587920.401276:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043923584 00000100:00100000:2.0:1788587920.401282:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043923584 00000100:00100000:2.0:1788587920.401318:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587920.401326:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+9:14357:x1875470043923584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587920.401336:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587920.401349:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca9357 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca9350 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.401369:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca9357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca9350 expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.401378:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca9357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca9350 expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.401386:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d000, rc 0) 00000100:00100000:2.0:1788587920.401417:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+10:14357:x1875470043923584:12345-0@lo:101:mount.lustre.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587920.401423:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587920.401549:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043923584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587920.401563:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9357 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.401572:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca9357 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587920.402167:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043923712:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788587920.402224:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587920.402246:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587920.402749:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043923712 00000100:00100000:2.0:1788587920.402756:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043923712 00000100:00100000:2.0:1788587920.402799:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587920.402807:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+10:14357:x1875470043923712:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788587920.402822:0:14369:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788587920.402828:0:14369:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788587920.402930:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+10:14357:x1875470043923712:12345-0@lo:256:mount.lustre.0 Request processed in 124us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587920.402939:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788587920.403320:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043923712:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788587920.404194:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788587920.404260:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9357 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587920.404270:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9357 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587920.404388:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f381d1d800 from 1 10000000:01000000:2.0:1788587920.404392:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587920.404430:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.404439:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.404449:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587920.404468:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382305c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043923840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587920.404520:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587920.404561:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b50d2000 going to sleep for 11 seconds 00000100:00100000:3.0:1788587920.404707:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043923840 00000100:00100000:3.0:1788587920.404715:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043923840 00000100:00100000:3.0:1788587920.404769:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587920.404778:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+10:14357:x1875470043923840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587920.404789:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587920.404802:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f480031c00/0xa13e120d54ca9365 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca935e expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.404824:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f480031c00/0xa13e120d54ca9365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca935e expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.404835:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f480031c00/0xa13e120d54ca9365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca935e expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.404876:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031c00, rc 0) 00000100:00100000:3.0:1788587920.404912:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+11:14357:x1875470043923840:12345-0@lo:101:mount.lustre.0 Request processed in 135us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587920.404918:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587920.407468:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382305c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043923840:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587920.407494:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9365 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587920.407523:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca9365 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587920.407614:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043923968:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587920.407677:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587920.407729:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4971c0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587920.407808:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043923968 00000100:00100000:2.0:1788587920.407814:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043923968 00000100:00100000:2.0:1788587920.407897:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587920.407906:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+11:14357:x1875470043923968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587920.408316:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+11:14357:x1875470043923968:12345-0@lo:501:mount.lustre.0 Request processed in 410us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587920.408331:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587920.409670:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043923968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587920.409720:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043924096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587920.409777:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587920.409814:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874780 going to sleep for 11 seconds 00000100:00100000:2.0:1788587920.412695:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043924096 00000100:00100000:2.0:1788587920.412710:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043924096 00000100:00100000:2.0:1788587920.412783:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587920.412794:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+11:14357:x1875470043924096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587920.413080:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+11:14357:x1875470043924096:12345-0@lo:503:mount.lustre.0 Request processed in 287us (3302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587920.413098:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587920.413231:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043924096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587920.417615:0:14400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382306680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:475e03e7-2028-419a-a63d-caf8ec05d538:14400:1875470043924224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587920.417714:0:14400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587920.417763:0:14400:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b50d2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587920.417909:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043924224 00000100:00100000:0.0:1788587920.417917:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043924224 00000100:00100000:0.0:1788587920.417965:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587920.417974:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+11:14400:x1875470043924224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587920.418245:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+11:14400:x1875470043924224:12345-0@lo:502:llog_process_th.0 Request processed in 272us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587920.418252:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587920.418510:0:14400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382306680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:475e03e7-2028-419a-a63d-caf8ec05d538:14400:1875470043924224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587920.418538:0:14400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587920.418547:0:14400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587920.418550:0:14400:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788587920.418557:0:14400:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88f381d1d800 00000020:00000080:2.0:1788587920.418559:0:14400:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788587920.418566:0:14400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587920.418568:0:14400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587920.418569:0:14400:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788587920.418571:0:14400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587920.418574:0:14400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587920.418575:0:14400:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788587920.418578:0:14400:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88f381d1d800 00000020:00000080:2.0:1788587920.418580:0:14400:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788587920.418643:0:14400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587920.418647:0:14400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587920.418648:0:14400:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788587920.418658:0:14400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587920.418661:0:14400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587920.418662:0:14400:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788587920.418666:0:14400:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88f381d1d800 00000020:00000080:2.0:1788587920.418668:0:14400:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788587920.420232:0:14400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382306680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:475e03e7-2028-419a-a63d-caf8ec05d538:14400:1875470043924352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587920.420304:0:14400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587920.422215:0:14400:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b50d2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587920.435323:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043924352 00000100:00100000:3.0:1788587920.435339:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043924352 00000100:00100000:3.0:1788587920.435404:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788587920.435412:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+11:14400:x1875470043924352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587920.435759:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+11:14400:x1875470043924352:12345-0@lo:502:llog_process_th.0 Request processed in 346us (15454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587920.435768:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788587920.436175:0:14400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382306680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:475e03e7-2028-419a-a63d-caf8ec05d538:14400:1875470043924352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587920.436213:0:14400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587920.436221:0:14400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587920.436224:0:14400:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788587920.436230:0:14400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788587920.436295:0:14357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788587920.436312:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587920.436328:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9365 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.436338:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9365 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587920.436378:0:14357:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788587920.436381:0:14357:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88f381d1d800 10000000:01000000:3.0:1788587920.436383:0:14357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88f381d1d800 10000000:01000000:3.0:1788587920.436387:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587920.436393:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88f381d1d800 from 1 10000000:01000000:3.0:1788587920.436395:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788587920.436423:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480031e00/0xa13e120d54ca936c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.436431:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f480031e00/0xa13e120d54ca936c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.436450:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f480031e00/0xa13e120d54ca936c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587920.436469:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043924480:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587920.436507:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587920.436533:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587920.436556:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043924480 00000100:00100000:3.0:1788587920.436561:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043924480 00000100:00100000:3.0:1788587920.436587:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788587920.436593:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+11:14357:x1875470043924480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587920.436603:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587920.436615:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f480030e00/0xa13e120d54ca9373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca936c expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.437364:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f480030e00/0xa13e120d54ca9373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca936c expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.437379:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f480030e00/0xa13e120d54ca9373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca936c expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.437389:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030e00, rc 0) 00000100:00100000:3.0:1788587920.437436:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+12:14357:x1875470043924480:12345-0@lo:101:mount.lustre.0 Request processed in 842us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587920.437443:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788587920.437551:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043924480:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587920.437566:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f480031e00/0xa13e120d54ca936c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9373 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.437581:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f480031e00/0xa13e120d54ca936c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca9373 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587920.438550:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043924608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587920.438601:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587920.438956:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587920.440067:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043924608 00000100:00100000:0.0:1788587920.440079:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043924608 00000100:00100000:0.0:1788587920.440131:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587920.440151:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+12:14357:x1875470043924608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587920.440429:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+12:14357:x1875470043924608:12345-0@lo:501:mount.lustre.0 Request processed in 279us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587920.440437:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788587920.440440:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043924608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587920.440485:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043924736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587920.440959:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587920.440998:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587920.441265:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043924736 00000100:00100000:2.0:1788587920.441272:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043924736 00000100:00100000:2.0:1788587920.441308:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788587920.441315:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+12:14357:x1875470043924736:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587920.441536:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+12:14357:x1875470043924736:12345-0@lo:503:mount.lustre.0 Request processed in 220us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587920.441544:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788587920.448000:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043924736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587920.449679:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:475e03e7-2028-419a-a63d-caf8ec05d538:14405:1875470043924864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587920.449754:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587920.449796:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7ba600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587920.449932:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043924864 00000100:00100000:0.0:1788587920.449939:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043924864 00000100:00100000:0.0:1788587920.449990:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788587920.449999:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+12:14405:x1875470043924864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587920.450237:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+12:14405:x1875470043924864:12345-0@lo:502:llog_process_th.0 Request processed in 238us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587920.450245:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587920.450334:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:475e03e7-2028-419a-a63d-caf8ec05d538:14405:1875470043924864:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788587920.450388:0:14405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788587920.450401:0:14405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff88f487028000) 00000020:00000080:1.0:1788587920.450418:0:14405:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788587920.450495:0:14405:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88f381d1d800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788587920.450499:0:14405:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88f381d1d800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788587920.450501:0:14405:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88f381d1d800 4 00010000:00080000:1.0:1788587920.450530:0:14405:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88f4c1925000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.133@tcp at head 00010000:00010000:1.0:1788587920.452171:0:14405:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788587920.452336:0:14405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788587920.452367:0:14405:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788587920.452380:0:14405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa13e120d54ca9381 00000100:00080000:1.0:1788587920.452389:0:14405:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587920.452395:0:14405:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88f4c1925000 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:1.0:1788587920.452428:0:14405:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f4bf76fb80 x1875470043924992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587920.452461:0:14405:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788587920.452732:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875470043924992:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788587920.452799:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587920.453957:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043924992 00000100:00100000:1.0:1788587920.453968:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043924992 00000100:00100000:1.0:1788587920.454004:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587920.454012:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875470043924992:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788587920.454087:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875470043924992:12345-0@lo:38:llog_process_th.0 Request processed in 74us (1287us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788587920.454095:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587920.454207:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:475e03e7-2028-419a-a63d-caf8ec05d538:14405:1875470043925120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587920.454253:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587920.454282:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043925120 00000100:00100000:1.0:1788587920.454286:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043925120 00000100:00100000:1.0:1788587920.454313:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788587920.454320:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+12:14405:x1875470043925120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587920.454548:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587920.454556:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4c1925000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587920.454561:0:3301:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788587920.454564:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875470043924992:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788587920.458169:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+12:14405:x1875470043925120:12345-0@lo:502:llog_process_th.0 Request processed in 3841us (3907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587920.458184:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788587920.458249:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf7ba000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587920.458273:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:475e03e7-2028-419a-a63d-caf8ec05d538:14405:1875470043925120:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788587920.458307:0:14405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788587920.458464:0:14357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788587920.458483:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788587920.458500:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480031e00/0xa13e120d54ca936c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9373 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587920.458510:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f480031e00/0xa13e120d54ca936c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9373 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788587920.458556:0:14357:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788587920.458558:0:14357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788587920.458559:0:14357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587920.458560:0:14357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587920.458561:0:14357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587920.458567:0:14357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587920.458568:0:14357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587920.458570:0:14357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788587920.458571:0:14357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587920.458573:0:14357:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587920.458576:0:14357:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788587920.458579:0:14357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587920.458580:0:14357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788587920.458580:0:14357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587920.458581:0:14357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587920.458582:0:14357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587920.458583:0:14357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587920.458584:0:14357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587920.458585:0:14357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788587920.458586:0:14357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587920.458587:0:14357:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587920.458607:0:14357:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788587920.458625:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043925248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788587920.458680:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587920.458705:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587920.458921:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043925248 00000100:00100000:1.0:1788587920.458927:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043925248 00000100:00100000:1.0:1788587920.458963:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587920.458971:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+12:14357:x1875470043925248:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788587920.458995:0:14367:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788587920.459007:0:14367:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788587920.540212:0:14367:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788587920.540227:0:14367:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788587920.540330:0:14390:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788587920.540336:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788587920.540362:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.540380:0:14390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca9357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca9350 expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.540389:0:14390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.540444:0:14390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca9357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca9350 expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.540458:0:14390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca9357 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca9350 expref: 12 pid: 14370 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587920.540473:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382305880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14390:1875470043925376:0@lo:104: 00000100:00100000:2.0:1788587920.540538:0:14390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587920.540587:0:14390:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b50d2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587920.540674:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043925376 00000100:00100000:0.0:1788587920.540682:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043925376 00000100:00100000:0.0:1788587920.540726:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587920.540735:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382305180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:475e03e7-2028-419a-a63d-caf8ec05d538+3:14390:x1875470043925376:12345-0@lo:104: 00010000:00010000:0.0:1788587920.540754:0:14358:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca9357 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587920.540803:0:14358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587920.540810:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382305180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:475e03e7-2028-419a-a63d-caf8ec05d538+3:14390:x1875470043925376:12345-0@lo:104: Request processed in 76us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587920.540816:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788587920.541099:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587920.541106:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca9357 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541112:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030800 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:2.0:1788587920.541116:0:14364:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca9357 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541124:0:14364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca9357 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587920.541131:0:14364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca9357 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587920.541148:0:14364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587920.541185:0:14364:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca9357 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541192:0:14364:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587920.541211:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca9357 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541224:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f480030800/0xa13e120d54ca9350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca9357 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541240:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587920.541242:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587920.541244:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587920.541262:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587920.541272:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:475e03e7-2028-419a-a63d-caf8ec05d538:3304:1875470043925504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587920.541305:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587920.541349:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043925504 00000100:00100000:2.0:1788587920.541353:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043925504 00010000:00010000:2.0:1788587920.541371:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca9357 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca9350 expref: 13 pid: 14370 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587920.541391:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587920.541398:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:475e03e7-2028-419a-a63d-caf8ec05d538+13:3304:x1875470043925504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587920.541408:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587920.541413:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca9357 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca9350 expref: 13 pid: 14370 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541423:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca9357 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca9350 expref: 13 pid: 14370 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541439:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541446:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788587920.541469:0:14360:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001133983s 00010000:00010000:2.0:1788587920.541473:0:14360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541480:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541486:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541491:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541497:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587920.541500:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541507:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541516:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541525:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587920.541555:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:475e03e7-2028-419a-a63d-caf8ec05d538+13:3304:x1875470043925504:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587920.541561:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587920.541597:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:475e03e7-2028-419a-a63d-caf8ec05d538:3304:1875470043925504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587920.541622:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4c159d000/0xa13e120d54ca9357 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca9350 expref: 12 pid: 14370 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587920.541654:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382305880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14390:1875470043925376:0@lo:104: 00010000:00010000:2.0:1788587920.541665:0:14390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541674:0:14390:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541681:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587920.541688:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4c159c000/0xa13e120d54ca9388 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587920.554712:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+11:14357:x1875470043925248:12345-0@lo:253:mount.lustre.0 Request processed in 95734us (96023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587920.554726:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587920.554792:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:14357:1875470043925248:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788587920.554807:0:14357:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788587920.554810:0:14357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788587920.554812:0:14357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788587920.554813:0:14357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587920.554814:0:14357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587920.554815:0:14357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587920.554817:0:14357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587920.554818:0:14357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788587920.554819:0:14357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788587920.554821:0:14357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587920.554823:0:14357:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788587920.554839:0:14357:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788587920.563226:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587920.563405:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587920.571245:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587920.571471:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587920.572012:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587920.572390:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587920.573780:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587920.574108:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587920.574403:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587920.574619:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587920.575171:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587920.575343:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788587920.620470:0:14357:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788587920.621107:0:14357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788587920.621323:0:14413:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788587920.621327:0:14413:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788587920.621430:0:14414:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788587920.621508:0:14414:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788587920.626159:0:14357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788587920.626292:0:14357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788587920.626732:0:14357:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788587920.626740:0:14357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788587920.627141:0:14357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587920.629461:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788587920.630616:0:14414:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788587920.631119:0:14414:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788587920.631124:0:14414:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1788587920.631159:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788587920.631209:0:14357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788587920.632361:0:14357:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1788587920.634063:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788587920.639442:0:14357:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788587920.685439:0:14357:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788587920.685487:0:14357:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0dd01a1b988 00100000:10000000:3.0:1788587920.685497:0:14357:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788587920.686538:0:14357:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788587920.686560:0:14357:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.133@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788587920.686576:0:14357:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788587920.686595:0:14357:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788587921.097026:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587921.481506:0:14406:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587921.481515:0:14406:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587921.482403:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1788587921.482412:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1788587922.057014:0:14373:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788587922.057021:0:14373:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88f381d1d800 from 6 10000000:01000000:0.0:1788587922.057026:0:14373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788587922.057067:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587922.057078:0:14373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587922.057104:0:14373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587922.057140:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043925632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587922.057197:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587922.057243:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4c216b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587922.057445:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043925632 00000100:00100000:2.0:1788587922.057452:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043925632 00000100:00100000:2.0:1788587922.057504:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587922.057513:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+11:14373:x1875470043925632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587922.057525:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587922.057537:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c159c800/0xa13e120d54ca9396 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca938f expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587922.057560:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159c800/0xa13e120d54ca9396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca938f expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587922.057571:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c159c800/0xa13e120d54ca9396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca938f expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587922.057589:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159c800, rc 0) 00000100:00100000:2.0:1788587922.057625:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+12:14373:x1875470043925632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587922.057632:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587922.057683:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043925632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587922.057697:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9396 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587922.057705:0:14373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca9396 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587922.057750:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382305880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043925760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788587922.057779:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587922.057797:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4851ee900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587922.057823:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043925760 00000100:00100000:2.0:1788587922.057826:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043925760 00000100:00100000:2.0:1788587922.057867:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587922.057873:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+12:14373:x1875470043925760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788587922.057887:0:14367:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788587922.057901:0:14367:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788587922.057904:0:14367:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788587922.057970:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+12:14373:x1875470043925760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 96us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587922.057977:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587922.058005:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382305880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043925760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788587922.058046:0:14373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788587922.058052:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9396 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587922.058060:0:14373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9396 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587922.120098:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587922.504383:0:14406:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587922.505819:0:14406:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587922.511230:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788587922.511475:0:14406:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587922.511524:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:3.0:1788587923.145376:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587924.167996:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587925.010274:0:14657:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg633-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788587925.194421:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788587925.961615:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587925.961621:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587925.961624:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587925.961627:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587925.961630:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788587925.961633:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788587925.961636:0:36:0:(import.c:65:import_set_state_nolock()) ffff88f4c1925000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587925.961647:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88f4c1925000 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:3.0:1788587925.961666:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f4bab65c00 x1875470043926016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587925.961705:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587925.961715:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:475e03e7-2028-419a-a63d-caf8ec05d538:3303:1875470043925888:0@lo:400:kworker.0 00000100:00100000:3.0:1788587925.961778:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587925.962029:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875470043926016:0@lo:38:kworker.0 00000100:00100000:3.0:1788587925.962058:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587925.962139:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043926016 00000100:00100000:1.0:1788587925.962147:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043926016 00000100:00100000:1.0:1788587925.962184:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587925.962191:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1875470043926016:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788587925.962214:0:14376:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:1.0:1788587925.962244:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa13e120d54ca939d 00000004:00100000:1.0:1788587925.962258:0:14376:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788587925.962377:0:14376:0:(import.c:65:import_set_state_nolock()) ffff88f4afd83800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587925.962421:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875470043926016:12345-0@lo:38:kworker.0 Request processed in 229us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587925.962428:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788587925.962463:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88f4bab65c00 x1875470043926016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587925.962476:0:3301:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788587925.962482:0:3301:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788587925.962486:0:3301:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788587925.962488:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4c1925000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788587925.962493:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875470043926016:0@lo:38:kworker.0 00000100:00100000:2.0:1788587925.962835:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043925888 00000100:00100000:2.0:1788587925.962865:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043925888 00000100:00100000:2.0:1788587925.962900:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788587925.962907:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+12:3303:x1875470043925888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587925.962954:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+12:3303:x1875470043925888:12345-0@lo:400:kworker.0 Request processed in 48us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587925.962960:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788587925.963132:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:475e03e7-2028-419a-a63d-caf8ec05d538:3303:1875470043925888:0@lo:400:kworker.0 00010000:00010000:1.0:1788587926.216616:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587927.245437:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788587927.782426:0:14810:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe146d31b0 20000000:00000080:3.0:1788587927.782444:0:14810:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88f4bbdb0400 uarg=0000000000000000 20000000:01000000:3.0:1788587927.782474:0:14810:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788587927.782481:0:14810:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788587927.782485:0:14810:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788587927.783466:0:14811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788587927.783668:0:14810:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788587927.791443:0:14810:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788587927.791474:0:14810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587927.791493:0:14810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f480031c00/0xa13e120d54ca9365 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca935e expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587927.791516:0:14810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587927.791556:0:14810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f480031c00/0xa13e120d54ca9365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca935e expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587927.791569:0:14810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f480031c00/0xa13e120d54ca9365 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca935e expref: 11 pid: 14367 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587927.791584:0:14810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14810:1875470043926144:0@lo:104: 00000100:00100000:1.0:1788587927.791710:0:14810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587927.791794:0:14810:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f493590c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587927.792499:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043926144 00000100:00100000:2.0:1788587927.792507:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043926144 00000100:00100000:2.0:1788587927.792601:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587927.792610:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:475e03e7-2028-419a-a63d-caf8ec05d538+3:14810:x1875470043926144:12345-0@lo:104: 00010000:00010000:2.0:1788587927.792624:0:14359:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca9365 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587927.792696:0:14359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788587927.792707:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:475e03e7-2028-419a-a63d-caf8ec05d538+3:14810:x1875470043926144:12345-0@lo:104: Request processed in 99us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587927.792715:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788587927.792754:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587927.792761:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca9365 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.792778:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d200 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:3.0:1788587927.792782:0:14364:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca9365 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.792790:0:14364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca9365 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587927.792797:0:14364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca9365 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587927.792803:0:14364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587927.792833:0:14364:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca9365 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.792858:0:14364:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587927.792878:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca9365 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.792886:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f4c159d200/0xa13e120d54ca935e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca9365 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.792901:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587927.792902:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587927.792904:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587927.792933:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:475e03e7-2028-419a-a63d-caf8ec05d538:3303:1875470043926272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587927.792965:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587927.793009:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043926272 00000100:00100000:3.0:1788587927.793013:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043926272 00010000:00010000:3.0:1788587927.793031:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f480031c00/0xa13e120d54ca9365 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca935e expref: 12 pid: 14367 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587927.793059:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587927.793066:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:475e03e7-2028-419a-a63d-caf8ec05d538+12:3303:x1875470043926272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587927.793077:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587927.793082:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f480031c00/0xa13e120d54ca9365 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca935e expref: 12 pid: 14367 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.793094:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f480031c00/0xa13e120d54ca9365 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca935e expref: 12 pid: 14367 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.793122:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.793130:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.793142:0:14360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.793148:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.793155:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.793162:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.793167:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0800 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:3.0:1788587927.793171:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.793183:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.793192:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587927.793202:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587927.793232:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:475e03e7-2028-419a-a63d-caf8ec05d538+12:3303:x1875470043926272:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587927.793238:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587927.793274:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:475e03e7-2028-419a-a63d-caf8ec05d538:3303:1875470043926272:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587927.793367:0:14810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f480031c00/0xa13e120d54ca9365 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca935e expref: 11 pid: 14367 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587927.793378:0:14810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14810:1875470043926144:0@lo:104: 00010000:00010000:1.0:1788587927.793391:0:14810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587927.793400:0:14810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587927.793407:0:14810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587927.793414:0:14810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4856c0800/0xa13e120d54ca93a4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587928.264323:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788587929.096296:0:14373:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788587929.096304:0:14373:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f381d1d800 from 10 10000000:01000000:3.0:1788587929.096308:0:14373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587929.096354:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587929.096365:0:14373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587929.096376:0:14373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587929.096403:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043926400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587929.096468:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587929.096589:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4af0c4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587929.099188:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043926400 00000100:00100000:0.0:1788587929.099201:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043926400 00000100:00100000:0.0:1788587929.099270:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587929.099279:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+11:14373:x1875470043926400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587929.099295:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587929.099313:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bf77aa00/0xa13e120d54ca93b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca93ab expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587929.099339:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bf77aa00/0xa13e120d54ca93b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca93ab expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587929.099349:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bf77aa00/0xa13e120d54ca93b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca93ab expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587929.099356:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77aa00, rc 0) 00000100:00100000:0.0:1788587929.099426:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+12:14373:x1875470043926400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (2957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587929.099432:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788587929.099551:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043926400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587929.099579:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca93b2 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587929.099588:0:14373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca93b2 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587929.099648:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043926528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587929.099680:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587929.099718:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4af0c4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587929.099772:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043926528 00000100:00100000:0.0:1788587929.099777:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043926528 00000100:00100000:0.0:1788587929.099805:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587929.099812:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+12:14373:x1875470043926528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587929.100182:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+12:14373:x1875470043926528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 369us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587929.100190:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587929.100591:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043926528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587929.100622:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043926656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587929.100657:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587929.100684:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4af0c4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587929.100736:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043926656 00000100:00100000:1.0:1788587929.100746:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043926656 00000100:00100000:1.0:1788587929.100778:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788587929.100785:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+12:14373:x1875470043926656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587929.100973:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+12:14373:x1875470043926656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587929.100980:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587929.101065:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043926656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788587929.102162:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788587929.102432:0:14373:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788587929.102451:0:14373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587929.102467:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca93b2 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587929.102477:0:14373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca93b2 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587929.288370:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587930.056799:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587920/real 1788587920] req@ffff88f38181ed80 x1875470043923328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587930 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587930.056833:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88f38181ed80 x1875470043923328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587930 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587930.056874:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587920/real 1788587920] req@ffff88f382305f80 x1875470043923200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587930 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587930.056891:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88f382305f80 x1875470043923200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587930 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788587930.057224:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f48661c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788587930.057248:0:3301:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788587930.057253:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043923328:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788587930.057259:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4afd98800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788587930.057264:0:3301:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788587930.057267:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043923200:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788587930.057386:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587930.057391:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788587930.057393:0:36:0:(import.c:65:import_set_state_nolock()) ffff88f4afd98800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587930.057399:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 367 00000100:00080000:1.0:1788587930.057405:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788587930.057411:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88f4afd98800 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:1.0:1788587930.057431:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f4bf76c700 x1875470043926912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587930.057446:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587930.057457:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788587930.057459:0:36:0:(import.c:65:import_set_state_nolock()) ffff88f48661c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587930.057463:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 367 00000100:00080000:1.0:1788587930.057466:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788587930.057469:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88f48661c000 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:1.0:1788587930.057483:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f4bf76c000 x1875470043927040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587930.057513:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043926912:0@lo:8:kworker.0 00000400:00000100:1.0:1788587930.057560:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875470043926912 offset 0 length 520: 4 00000100:00100000:1.0:1788587930.057598:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043927040:0@lo:8:kworker.0 00000400:00000100:1.0:1788587930.057613:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875470043927040 offset 0 length 520: 4 00000100:00100000:2.0:1788587930.057675:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:475e03e7-2028-419a-a63d-caf8ec05d538:3304:1875470043926784:0@lo:400:kworker.0 00000100:00100000:2.0:1788587930.057715:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587930.057741:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587930.057747:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043927168:0@lo:400:kworker.0 00000100:00100000:2.0:1788587930.057786:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587930.057824:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043927168 00000100:00100000:0.0:1788587930.057832:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043927168 00000100:00100000:0.0:1788587930.057900:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587930.057909:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043927168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587930.057960:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043927168:12345-0@lo:400:kworker.0 Request processed in 52us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587930.057967:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788587930.057990:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88f4bf76e300 x1875470043927168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587930.058003:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043927168:0@lo:400:kworker.0 00000100:00100000:1.0:1788587930.058150:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043926784 00000100:00100000:1.0:1788587930.058155:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043926784 00000100:00100000:1.0:1788587930.058189:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788587930.058196:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+12:3304:x1875470043926784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587930.058239:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+12:3304:x1875470043926784:12345-0@lo:400:kworker.0 Request processed in 43us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587930.058245:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788587930.058459:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:475e03e7-2028-419a-a63d-caf8ec05d538:3304:1875470043926784:0@lo:400:kworker.0 00010000:00010000:3.0:1788587930.313828:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587931.343858:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587932.360020:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788587932.381020:0:15058:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788587932.381023:0:15058:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788587932.381140:0:15058:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88f48661b800 00000020:01000004:3.0:1788587932.381155:0:15058:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788587932.381239:0:15058:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788587932.381253:0:15058:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff88f4856999c0) 00000020:00000080:3.0:1788587932.381267:0:15058:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788587932.408288:0:15058:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788587932.408576:0:15058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788587932.410392:0:15058:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788587932.410693:0:15058:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788587932.411155:0:15058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788587932.411507:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 125: rc = 0 00100000:10000000:2.0:1788587932.411717:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 125: rc = 0 00100000:10000000:2.0:1788587932.412090:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 125: rc = 0 00100000:10000000:2.0:1788587932.412485:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 774: rc = 0 00100000:10000000:2.0:1788587932.413455:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 774: rc = 0 00100000:10000000:2.0:1788587932.414101:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 774: rc = 0 00100000:10000000:2.0:1788587932.414366:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 774: rc = 0 00100000:10000000:2.0:1788587932.414605:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 774: rc = 0 00100000:10000000:2.0:1788587932.415172:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 774: rc = 0 00000020:00000080:2.0:1788587932.415680:0:15058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788587932.415690:0:15058:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788587932.415699:0:15058:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa13e120d54ca93c0 00000020:01000004:2.0:1788587932.415706:0:15058:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788587932.415724:0:15058:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.133@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788587932.415728:0:15058:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788587932.415733:0:15058:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788587932.415737:0:15058:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788587932.415748:0:15058:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff88f4af0d8000) 00000020:00000080:2.0:1788587932.415757:0:15058:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788587932.418554:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587932.418724:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788587932.418730:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788587932.419749:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788587932.419757:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788587932.420286:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788587932.420293:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788587932.422401:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587932.422572:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788587932.422578:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788587932.423561:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788587932.423568:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788587932.453331:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587932.453542:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788587932.453548:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788587932.457741:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788587932.457794:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788587932.462685:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788587932.462709:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788587932.467316:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587932.467508:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788587932.467514:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788587932.470202:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788587932.470219:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788587932.521286:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587932.521500:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788587932.521508:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788587932.526777:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788587932.526792:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788587932.538424:0:15058:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788587932.538749:0:15058:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788587932.538756:0:15058:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.133@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788587932.559372:0:15058:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.133@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788587932.559410:0:15058:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.133@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788587932.559417:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788587932.559419:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587932.559420:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587932.559420:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587932.559421:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587932.559422:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587932.559423:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587932.559425:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587932.559426:0:15058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788587932.559429:0:15058:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788587932.559430:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788587932.559431:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587932.559432:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587932.559433:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587932.559434:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587932.559435:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587932.559435:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587932.559436:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587932.559437:0:15058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788587932.559475:0:15058:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788587932.559496:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043927296:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788587932.559565:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587932.559708:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488b99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587932.564080:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043927296 00000100:00100000:3.0:1788587932.564152:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043927296 00000100:00100000:3.0:1788587932.564272:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788587932.564283:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+12:15058:x1875470043927296:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788587932.564331:0:14369:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788587932.564335:0:14369:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788587932.564338:0:14369:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788587932.589270:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+12:15058:x1875470043927296:12345-0@lo:253:mount.lustre.0 Request processed in 24979us (29694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587932.589283:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587932.589295:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043927296:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788587932.589312:0:15058:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788587932.589315:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788587932.589316:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587932.589318:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587932.589319:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587932.589320:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587932.589321:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587932.589322:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587932.589324:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587932.589325:0:15058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788587932.589343:0:15058:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88f48661b800 from lustre-OST0000 10000000:01000000:0.0:1788587932.589365:0:15058:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788587932.589368:0:15058:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788587932.589380:0:15058:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88f4870299c0 local copy 00010000:00010000:0.0:1788587932.589390:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77a400/0xa13e120d54ca92b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92bd expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587932.589605:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043927424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587932.589639:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587932.589679:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4af0c4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587932.589748:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043927424 00000100:00100000:1.0:1788587932.589762:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043927424 00000100:00100000:1.0:1788587932.589805:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788587932.589813:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+12:15058:x1875470043927424:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587932.590170:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+12:15058:x1875470043927424:12345-0@lo:501:mount.lustre.0 Request processed in 357us (529us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587932.590178:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788587932.590202:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043927424:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788587932.590215:0:15058:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788587932.590368:0:15058:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788587932.590375:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77a400/0xa13e120d54ca92b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92bd expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.590384:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4bf77a400/0xa13e120d54ca92b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92bd expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587932.590404:0:15058:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88f48661b800 10000000:01000000:3.0:1788587932.590409:0:15058:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788587932.590412:0:15058:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff88f4870299c0 10000000:01000000:3.0:1788587932.590414:0:15058:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788587932.590417:0:15058:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff88f4870299c0 from 1 10000000:01000000:3.0:1788587932.590420:0:15058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788587932.590442:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480030400/0xa13e120d54ca93ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.590458:0:15058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f480030400/0xa13e120d54ca93ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.590467:0:15058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f480030400/0xa13e120d54ca93ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587932.590481:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043927552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587932.590508:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587932.590536:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4971c0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587932.590863:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043927552 00000100:00100000:0.0:1788587932.590870:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043927552 00000100:00100000:0.0:1788587932.590917:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587932.590926:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+12:15058:x1875470043927552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587932.590936:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587932.590948:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bf77b800/0xa13e120d54ca93d5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca93ce expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.590969:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bf77b800/0xa13e120d54ca93d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca93ce expref: 13 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.590980:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bf77b800/0xa13e120d54ca93d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca93ce expref: 13 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.590988:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b800, rc 0) 00000100:00100000:0.0:1788587932.591027:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+13:15058:x1875470043927552:12345-0@lo:101:mount.lustre.0 Request processed in 103us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587932.591033:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587932.591184:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043927552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587932.591198:0:15058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f480030400/0xa13e120d54ca93ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca93d5 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.591207:0:15058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f480030400/0xa13e120d54ca93ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca93d5 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587932.591225:0:15058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788587932.591243:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480030400/0xa13e120d54ca93ce lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca93d5 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.591250:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f480030400/0xa13e120d54ca93ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca93d5 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587932.591257:0:15058:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788587932.591261:0:15058:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587932.591265:0:15058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788587932.591267:0:15058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788587932.591292:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca93dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.591299:0:15058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca93dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.591305:0:15058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca93dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587932.591318:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043927680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587932.591347:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587932.591375:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4971c0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587932.592028:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043927680 00000100:00100000:0.0:1788587932.592035:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043927680 00000100:00100000:0.0:1788587932.592088:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587932.592096:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+13:15058:x1875470043927680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587932.592113:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587932.592124:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bf77b000/0xa13e120d54ca93e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca93dc expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.592141:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bf77b000/0xa13e120d54ca93e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca93dc expref: 14 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.592150:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bf77b000/0xa13e120d54ca93e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca93dc expref: 14 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.592157:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77b000, rc 0) 00000100:00100000:0.0:1788587932.592204:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+14:15058:x1875470043927680:12345-0@lo:101:mount.lustre.0 Request processed in 108us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587932.592210:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788587932.592294:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043927680:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587932.592307:0:15058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca93dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca93e3 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587932.592316:0:15058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca93dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca93e3 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587932.592979:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788587932.593811:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587932.594119:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788587932.594165:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788587932.594200:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788587932.594253:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788587932.594291:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788587932.594326:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788587932.594401:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788587932.594410:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788587932.594479:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043927808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587932.594536:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587932.594582:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491fee780 going to sleep for 11 seconds 00000100:00100000:2.0:1788587932.594705:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043927808 00000100:00100000:2.0:1788587932.594712:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043927808 00000100:00100000:2.0:1788587932.596301:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587932.596330:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+14:15058:x1875470043927808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587932.596761:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+14:15058:x1875470043927808:12345-0@lo:501:mount.lustre.0 Request processed in 436us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587932.596770:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788587932.596830:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043927808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587932.597083:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043927936:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587932.597134:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587932.597169:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491fee780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587932.597221:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043927936 00000100:00100000:0.0:1788587932.597228:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043927936 00000100:00100000:0.0:1788587932.597270:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788587932.597277:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+14:15058:x1875470043927936:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587932.597559:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+14:15058:x1875470043927936:12345-0@lo:503:mount.lustre.0 Request processed in 283us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587932.597566:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788587932.597645:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043927936:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788587932.598452:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587932.598516:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587932.598564:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587932.598605:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491fee780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587932.598698:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043928064 00000100:00100000:3.0:1788587932.598704:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043928064 00000100:00100000:3.0:1788587932.598741:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788587932.598749:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+14:15058:x1875470043928064:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587932.599091:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+14:15058:x1875470043928064:12345-0@lo:502:mount.lustre.0 Request processed in 341us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587932.599099:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587932.599238:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928064:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788587932.599488:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788587932.599539:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788587932.599574:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788587932.599988:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788587932.600030:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788587932.600964:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788587932.601041:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788587932.601290:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788587932.601330:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788587932.601375:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788587932.601405:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788587932.601464:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788587932.601507:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382306300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587932.601573:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587932.601622:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4811ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587932.601795:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043928192 00000100:00100000:1.0:1788587932.601802:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043928192 00000100:00100000:1.0:1788587932.601938:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788587932.601948:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+14:15058:x1875470043928192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587932.602175:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+14:15058:x1875470043928192:12345-0@lo:502:mount.lustre.0 Request processed in 228us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587932.602184:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788587932.602268:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382306300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788587932.602339:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788587932.602348:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788587932.605222:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788587932.605233:0:15072:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788587932.605239:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587932.605241:0:15072:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788587932.605247:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788587932.605277:0:15072:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff88f4a4fb4d40) 00000020:00000080:0.0:1788587932.605300:0:15072:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788587932.605306:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788587932.605385:0:15072:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88f48661b800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788587932.605393:0:15072:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788587932.605400:0:15072:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa13e120d54ca93f1 00010000:00010000:1.0:1788587932.611208:0:15072:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788587932.611703:0:15072:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788587932.614034:0:15072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788587932.615998:0:15072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788587932.616010:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587932.616706:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587932.616709:0:15072:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788587932.616715:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788587932.616718:0:15072:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788587932.616720:0:15072:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788587932.616721:0:15072:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788587932.616723:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788587932.616726:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587932.616727:0:15072:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788587932.616736:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587932.616740:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587932.616741:0:15072:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788587932.616744:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788587932.616746:0:15072:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788587932.616749:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587932.616751:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587932.616752:0:15072:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788587932.616754:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587932.616756:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587932.616758:0:15072:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788587932.616760:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788587932.616815:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587932.616818:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587932.616819:0:15072:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788587932.616822:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788587932.626214:0:15058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788587932.626254:0:15058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788587932.626311:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca93dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca93e3 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.626324:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f480031800/0xa13e120d54ca93dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca93e3 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587932.626345:0:15058:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f48661b800 from 1 10000000:01000000:3.0:1788587932.626348:0:15058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587932.626403:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.626412:0:15058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.626422:0:15058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587932.626445:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587932.626511:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587932.626551:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043928320 00000100:00100000:3.0:1788587932.626558:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043928320 00000100:00100000:3.0:1788587932.626615:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587932.626624:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+14:15058:x1875470043928320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587932.626636:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587932.626648:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f480031200/0xa13e120d54ca93ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca93f8 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.626669:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f480031200/0xa13e120d54ca93ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca93f8 expref: 15 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.626680:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f480031200/0xa13e120d54ca93ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca93f8 expref: 15 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.626689:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031200, rc 0) 00000100:00100000:3.0:1788587932.626723:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+15:15058:x1875470043928320:12345-0@lo:101:mount.lustre.0 Request processed in 100us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587932.626730:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587932.626771:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4971c0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587932.626791:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587932.626804:0:15058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca93ff expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.626813:0:15058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca93ff expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587932.627797:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788587932.628497:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587932.628828:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788587932.629289:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788587932.629358:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788587932.629366:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788587932.629437:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587932.629490:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587932.629528:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4971c0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587932.630343:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043928448 00000100:00100000:1.0:1788587932.630353:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043928448 00000100:00100000:1.0:1788587932.630391:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788587932.630400:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+15:15058:x1875470043928448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587932.630657:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+15:15058:x1875470043928448:12345-0@lo:501:mount.lustre.0 Request processed in 256us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587932.630665:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788587932.630836:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587932.630904:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382306300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587932.630961:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587932.630993:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587932.631477:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043928576 00000100:00100000:1.0:1788587932.631483:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043928576 00000100:00100000:1.0:1788587932.631511:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788587932.631518:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+15:15058:x1875470043928576:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587932.631827:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+15:15058:x1875470043928576:12345-0@lo:503:mount.lustre.0 Request processed in 308us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587932.631835:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788587932.631966:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382306300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928576:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788587932.633016:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788587932.633393:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382306300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587932.633452:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587932.633606:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4b4874b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587932.633711:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043928704 00000100:00100000:3.0:1788587932.633718:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043928704 00000100:00100000:3.0:1788587932.633762:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788587932.633771:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+15:15058:x1875470043928704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587932.634185:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+15:15058:x1875470043928704:12345-0@lo:502:mount.lustre.0 Request processed in 414us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587932.634193:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788587932.634342:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382306300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587932.634631:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788587932.634680:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788587932.634728:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788587932.634765:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788587932.634797:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788587932.634833:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788587932.635017:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788587932.635066:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788587932.635173:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587932.635215:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587932.635244:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4971c0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587932.635318:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043928832 00000100:00100000:2.0:1788587932.635324:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043928832 00000100:00100000:2.0:1788587932.635348:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788587932.635354:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+15:15058:x1875470043928832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587932.635486:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+15:15058:x1875470043928832:12345-0@lo:502:mount.lustre.0 Request processed in 131us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587932.635493:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788587932.635578:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928832:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587932.635721:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788587932.635730:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788587932.645821:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587932.645838:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587932.645956:0:15076:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788587932.645969:0:15076:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88f48661b800 00000020:00000080:2.0:1788587932.645972:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788587932.645979:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587932.645982:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587932.645983:0:15076:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788587932.645986:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587932.645988:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587932.645990:0:15076:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788587932.645993:0:15076:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88f48661b800 00000020:00000080:2.0:1788587932.645995:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788587932.646066:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587932.646665:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587932.646668:0:15076:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788587932.646673:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587932.646677:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587932.646679:0:15076:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788587932.646683:0:15076:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88f48661b800 00000020:00000080:2.0:1788587932.646685:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788587932.646745:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587932.646749:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587932.646751:0:15076:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788587932.646755:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788587932.652437:0:15058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788587932.652494:0:15058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587932.652525:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca93ff expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587932.652541:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca93ff expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587932.652616:0:15058:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788587932.652620:0:15058:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88f48661b800 10000000:01000000:1.0:1788587932.652623:0:15058:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88f48661b800 10000000:01000000:1.0:1788587932.652628:0:15058:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788587932.652633:0:15058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88f48661b800 from 1 10000000:01000000:1.0:1788587932.652636:0:15058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788587932.652670:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4856c1c00/0xa13e120d54ca9406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587932.652679:0:15058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4856c1c00/0xa13e120d54ca9406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587932.652690:0:15058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4856c1c00/0xa13e120d54ca9406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587932.652715:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788587932.652781:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587932.652815:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4908e1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587932.652961:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043928960 00000100:00100000:2.0:1788587932.652968:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043928960 00000100:00100000:2.0:1788587932.653011:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788587932.653019:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+15:15058:x1875470043928960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587932.653031:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587932.653043:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c159d600/0xa13e120d54ca940d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca9406 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587932.653064:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159d600/0xa13e120d54ca940d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca9406 expref: 16 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587932.653086:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c159d600/0xa13e120d54ca940d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca9406 expref: 16 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587932.653103:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d600, rc 0) 00000100:00100000:2.0:1788587932.653145:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+16:15058:x1875470043928960:12345-0@lo:101:mount.lustre.0 Request processed in 126us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587932.653152:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788587932.653998:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043928960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587932.654017:0:15058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4856c1c00/0xa13e120d54ca9406 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca940d expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587932.654039:0:15058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4856c1c00/0xa13e120d54ca9406 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca940d expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587932.654740:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788587932.658292:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587932.658617:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788587932.658665:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788587932.658703:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788587932.658751:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788587932.658805:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788587932.658886:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788587932.658921:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788587932.658956:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788587932.659000:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788587932.659030:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788587932.659061:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788587932.666513:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788587932.666598:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788587932.666637:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788587932.666687:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788587932.666729:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788587932.666765:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788587932.666813:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788587932.671765:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788587932.671945:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788587932.672044:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788587932.672161:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788587932.672201:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788587932.672252:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788587932.672288:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788587932.672319:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788587932.672379:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788587932.672411:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788587932.672486:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788587932.672493:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788587932.672586:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043929088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587932.672648:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587932.672694:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4908e1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587932.672787:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043929088 00000100:00100000:0.0:1788587932.672795:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043929088 00000100:00100000:0.0:1788587932.672837:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788587932.672940:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+16:15058:x1875470043929088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587932.673233:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+16:15058:x1875470043929088:12345-0@lo:501:mount.lustre.0 Request processed in 296us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587932.673240:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788587932.673998:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043929088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587932.674044:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043929216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587932.674253:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587932.674319:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4908e1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587932.679778:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043929216 00000100:00100000:2.0:1788587932.679797:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043929216 00000100:00100000:2.0:1788587932.679961:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788587932.679973:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+16:15058:x1875470043929216:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587932.680341:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+16:15058:x1875470043929216:12345-0@lo:503:mount.lustre.0 Request processed in 370us (6087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587932.680349:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788587932.682979:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043929216:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788587932.685344:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587932.685432:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043929344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587932.685519:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587932.685565:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4908e1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587932.685677:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043929344 00000100:00100000:2.0:1788587932.685684:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043929344 00000100:00100000:2.0:1788587932.685732:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788587932.685741:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+16:15058:x1875470043929344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587932.686250:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+16:15058:x1875470043929344:12345-0@lo:502:mount.lustre.0 Request processed in 508us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587932.686259:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587932.686373:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043929344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587932.686662:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788587932.686714:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788587932.686750:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788587932.686797:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788587932.686951:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788587932.687009:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788587932.687048:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788587932.687172:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788587932.687229:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788587932.687266:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788587932.687314:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788587932.687379:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788587932.687420:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788587932.687455:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788587932.687503:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788587932.687540:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788587932.687575:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788587932.687648:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788587932.687689:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788587932.687726:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788587932.687794:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788587932.687831:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788587932.688236:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788587932.688288:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788587932.688325:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788587932.688359:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788587932.688407:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788587932.688442:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788587932.688475:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788587932.688517:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788587932.688545:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788587932.688571:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788587932.688596:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788587932.688638:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788587932.688668:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788587932.688705:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788587932.689482:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788587932.689522:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788587932.689577:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788587932.689615:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788587932.689665:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043929472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587932.689740:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587932.689836:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4908e1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587932.690393:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043929472 00000100:00100000:2.0:1788587932.690400:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043929472 00000100:00100000:2.0:1788587932.690491:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788587932.690501:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+16:15058:x1875470043929472:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587932.690736:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+16:15058:x1875470043929472:12345-0@lo:502:mount.lustre.0 Request processed in 236us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587932.690745:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788587932.690823:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043929472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587932.690945:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788587932.690956:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788587932.691956:0:15081:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788587932.691971:0:15081:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff88f48702b380) 00000020:00000080:1.0:1788587932.691991:0:15081:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788587932.692062:0:15081:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88f48661b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788587932.692066:0:15081:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88f48661b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788587932.692068:0:15081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88f48661b800 3 00010000:00080000:1.0:1788587932.692171:0:15081:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88f4b50fb000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.133@tcp at head 00010000:00010000:1.0:1788587932.694431:0:15081:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788587932.694682:0:15081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788587932.694718:0:15081:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788587932.694729:0:15081:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa13e120d54ca941b 00000100:00080000:1.0:1788587932.694739:0:15081:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587932.694744:0:15081:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88f4b50fb000 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:1.0:1788587932.694776:0:15081:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f4bf76df80 x1875470043929600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587932.694808:0:15081:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1788587932.695050:0:15081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:3.0:1788587932.695350:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587932.695355:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587932.695358:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587932.695360:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587932.695410:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587932.695422:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043929728:0@lo:400:kworker.0 00000100:00100000:3.0:1788587932.695479:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587932.695524:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043929728 00000100:00100000:3.0:1788587932.695531:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043929728 00000100:00100000:3.0:1788587932.695568:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587932.695577:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043929728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587932.695624:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043929728:12345-0@lo:400:kworker.0 Request processed in 48us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587932.695631:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788587932.695666:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88f4bab65500 x1875470043929728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587932.695679:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043929728:0@lo:400:kworker.0 00000020:01000000:3.0:1788587932.695701:0:15058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788587932.695733:0:15058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788587932.695746:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4856c1c00/0xa13e120d54ca9406 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca940d expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.695756:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4856c1c00/0xa13e120d54ca9406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca940d expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788587932.695797:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788587932.695799:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788587932.695800:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587932.695801:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587932.695802:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587932.695804:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587932.695805:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587932.695806:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587932.695808:0:15058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587932.695811:0:15058:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788587932.695814:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587932.695815:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788587932.695816:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587932.695817:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587932.695818:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587932.695819:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587932.695820:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587932.695821:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587932.695822:0:15058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587932.695837:0:15058:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788587932.695933:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043929856:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788587932.695968:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587932.695995:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043929856 00000100:00100000:3.0:1788587932.695999:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043929856 00000100:00100000:3.0:1788587932.696027:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587932.696034:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+16:15058:x1875470043929856:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788587932.696054:0:14369:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788587932.696082:0:14369:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788587932.696458:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4971c0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587932.696545:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875470043929600:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587932.696596:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587932.696768:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043929600 00000100:00100000:3.0:1788587932.696773:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043929600 00000100:00100000:3.0:1788587932.696876:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587932.696882:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1875470043929600:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788587932.696902:0:14375:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:3.0:1788587932.696933:0:14375:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa13e120d54ca9422 00000004:00100000:3.0:1788587932.696946:0:14375:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788587932.696974:0:14375:0:(import.c:65:import_set_state_nolock()) ffff88f4bf849000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587932.697017:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875470043929600:12345-0@lo:38:llog_process_th.0 Request processed in 133us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587932.697024:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788587932.700258:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88f4bf76df80 x1875470043929600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587932.700272:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788587932.700282:0:3301:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788587932.700291:0:3301:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788587932.700295:0:3301:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788587932.700298:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4b50fb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788587932.700304:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875470043929600:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788587932.740737:0:14369:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788587932.740758:0:14369:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788587932.740817:0:14390:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788587932.740821:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788587932.740867:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.740886:0:14390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4c159c800/0xa13e120d54ca9396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca938f expref: 16 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.740907:0:14390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.740947:0:14390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4c159c800/0xa13e120d54ca9396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca938f expref: 16 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.740962:0:14390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f4c159c800/0xa13e120d54ca9396 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca938f expref: 16 pid: 14369 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587932.740978:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab67480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14390:1875470043929984:0@lo:104: 00000100:00100000:3.0:1788587932.741039:0:14390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587932.741083:0:14390:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4857a0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587932.741382:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043929984 00000100:00100000:0.0:1788587932.741390:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043929984 00000100:00100000:0.0:1788587932.741433:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587932.741443:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:475e03e7-2028-419a-a63d-caf8ec05d538+3:14390:x1875470043929984:12345-0@lo:104: 00010000:00010000:0.0:1788587932.741455:0:14358:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca9396 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741509:0:14358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587932.741514:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:475e03e7-2028-419a-a63d-caf8ec05d538+3:14390:x1875470043929984:12345-0@lo:104: Request processed in 74us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587932.741521:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788587932.741542:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587932.741548:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca9396 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741555:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77bc00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:0.0:1788587932.741559:0:14364:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca9396 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741575:0:14364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca9396 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587932.741582:0:14364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca9396 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587932.741588:0:14364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587932.741615:0:14364:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca9396 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741622:0:14364:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587932.741640:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca9396 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741646:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f4bf77bc00/0xa13e120d54ca938f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca9396 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741661:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587932.741663:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587932.741664:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587932.741677:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587932.741688:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:475e03e7-2028-419a-a63d-caf8ec05d538:3302:1875470043930112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587932.741715:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587932.741758:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043930112 00000100:00100000:0.0:1788587932.741762:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043930112 00010000:00010000:0.0:1788587932.741779:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4c159c800/0xa13e120d54ca9396 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca938f expref: 17 pid: 14369 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587932.741800:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587932.741813:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:475e03e7-2028-419a-a63d-caf8ec05d538+17:3302:x1875470043930112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587932.741823:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587932.741829:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4c159c800/0xa13e120d54ca9396 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca938f expref: 17 pid: 14369 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741839:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4c159c800/0xa13e120d54ca9396 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca938f expref: 17 pid: 14369 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741891:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741898:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788587932.741911:0:14362:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001133983s 00010000:00010000:0.0:1788587932.741916:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741923:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741931:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741937:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741943:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030600 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:0.0:1788587932.741948:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741966:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741976:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587932.741986:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587932.742017:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:475e03e7-2028-419a-a63d-caf8ec05d538+17:3302:x1875470043930112:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587932.742025:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587932.742056:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:475e03e7-2028-419a-a63d-caf8ec05d538:3302:1875470043930112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587932.742199:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4c159c800/0xa13e120d54ca9396 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca938f expref: 16 pid: 14369 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587932.742209:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab67480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14390:1875470043929984:0@lo:104: 00010000:00010000:3.0:1788587932.742222:0:14390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.742230:0:14390:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.742237:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587932.742243:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f480030600/0xa13e120d54ca9429 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587932.744477:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788587932.755086:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+15:15058:x1875470043929856:12345-0@lo:253:mount.lustre.0 Request processed in 59032us (59097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587932.755101:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587932.755235:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15058:1875470043929856:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788587932.755257:0:15058:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788587932.755260:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788587932.755262:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788587932.755263:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587932.755264:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587932.755265:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587932.755266:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587932.755267:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587932.755269:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587932.755270:0:15058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788587932.755285:0:15058:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788587932.764265:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587932.764430:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587932.765770:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587932.766101:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788587932.766241:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587932.766415:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788587932.769485:0:15058:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788587932.836811:0:15058:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788587932.836821:0:15058:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788587932.836877:0:15058:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788587932.837017:0:15058:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.133@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788587932.837040:0:15058:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788587932.837065:0:15058:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788587933.384494:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587934.409979:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788587934.665193:0:14373:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788587934.665201:0:14373:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88f381d1d800 from 7 10000000:01000000:2.0:1788587934.665205:0:14373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788587934.665256:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587934.665267:0:14373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587934.665278:0:14373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587934.665303:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382304380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043930240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587934.665366:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587934.665429:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f487a6b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587934.667322:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043930240 00000100:00100000:0.0:1788587934.667335:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043930240 00000100:00100000:0.0:1788587934.667598:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788587934.667611:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+15:14373:x1875470043930240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587934.667629:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587934.667646:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bf77a600/0xa13e120d54ca9437 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca9430 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587934.667675:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bf77a600/0xa13e120d54ca9437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca9430 expref: 16 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587934.667686:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bf77a600/0xa13e120d54ca9437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca9430 expref: 16 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587934.667695:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bf77a600, rc 0) 00000100:00100000:0.0:1788587934.667764:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+16:14373:x1875470043930240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (2397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587934.673334:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788587934.673840:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382304380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043930240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587934.673882:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9437 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587934.673895:0:14373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca9437 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587934.673960:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043930368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788587934.674011:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587934.674117:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f487070540 going to sleep for 11 seconds 00000100:00100000:2.0:1788587934.677483:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043930368 00000100:00100000:2.0:1788587934.677497:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043930368 00000100:00100000:2.0:1788587934.677589:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788587934.677598:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+16:14373:x1875470043930368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788587934.677622:0:14369:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788587934.677637:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788587934.677641:0:14369:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788587934.677751:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+16:14373:x1875470043930368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 154us (3738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587934.677824:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788587934.680926:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043930368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788587934.681005:0:14373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788587934.681014:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9437 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587934.681025:0:14373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9437 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587935.434494:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587936.461706:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587937.480032:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788587937.736015:0:13922:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587937.736022:0:13922:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587937.736024:0:13922:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587937.736027:0:13922:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587937.736192:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043930624:0@lo:400:kworker.0 00000100:00100000:3.0:1788587937.736257:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587937.736313:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587937.736320:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:475e03e7-2028-419a-a63d-caf8ec05d538:3305:1875470043930496:0@lo:400:kworker.0 00000100:00100000:3.0:1788587937.736349:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587937.736379:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043930752:0@lo:400:kworker.0 00000100:00100000:3.0:1788587937.736401:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587937.736435:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043930624 00000100:00100000:3.0:1788587937.736442:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043930624 00000100:00100000:3.0:1788587937.736476:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043930752 00000100:00100000:3.0:1788587937.736480:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043930752 00000100:00100000:3.0:1788587937.736511:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587937.736520:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043930624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587937.736578:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043930624:12345-0@lo:400:kworker.0 Request processed in 59us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587937.736585:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587937.736601:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587937.736608:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043930752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587937.736637:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043930752:12345-0@lo:400:kworker.0 Request processed in 30us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587937.736644:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587937.736660:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043930496 00000100:00100000:3.0:1788587937.736664:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043930496 00000100:00100000:3.0:1788587937.736687:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788587937.736693:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+16:3305:x1875470043930496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587937.736720:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+16:3305:x1875470043930496:12345-0@lo:400:kworker.0 Request processed in 28us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587937.736727:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788587937.736773:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4bab64a80 x1875470043930752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587937.736786:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043930752:0@lo:400:kworker.0 00000100:00100000:3.0:1788587937.736814:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:475e03e7-2028-419a-a63d-caf8ec05d538:3305:1875470043930496:0@lo:400:kworker.0 00010000:00080000:3.0:1788587937.736837:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f4bab67480 x1875470043930624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587937.736867:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043930624:0@lo:400:kworker.0 00000100:00080000:3.0:1788587937.736909:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788587938.504428:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788587938.812658:0:15426:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg633-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788587939.532952:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587940.553689:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587941.580392:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587942.600924:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788587942.859598:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587942.859607:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587942.859610:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587942.859620:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788587942.859705:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:475e03e7-2028-419a-a63d-caf8ec05d538:3303:1875470043930880:0@lo:400:kworker.0 00000100:00100000:0.0:1788587942.859888:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587942.859970:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043931136:0@lo:400:kworker.0 00000100:00100000:0.0:1788587942.860007:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587942.860043:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587942.860049:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043931008:0@lo:400:kworker.0 00000100:00100000:0.0:1788587942.860075:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587942.860110:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043931136 00000100:00100000:0.0:1788587942.860259:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043931136 00000100:00100000:2.0:1788587942.860317:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043930880 00000100:00100000:2.0:1788587942.860323:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043930880 00000100:00100000:0.0:1788587942.860357:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043931008 00000100:00100000:2.0:1788587942.860360:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788587942.860360:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043931008 00000100:00100000:2.0:1788587942.860369:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+16:3303:x1875470043930880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587942.860373:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587942.860378:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043931136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587942.860425:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875470043931136:12345-0@lo:400:kworker.0 Request processed in 47us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587942.860430:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+16:3303:x1875470043930880:12345-0@lo:400:kworker.0 Request processed in 63us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587942.860433:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587942.860436:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788587942.860450:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587942.860455:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043931008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587942.860481:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043931008:12345-0@lo:400:kworker.0 Request processed in 26us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587942.860488:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788587942.860532:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f38181ea00 x1875470043931008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587942.860546:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043931008:0@lo:400:kworker.0 00010000:00080000:0.0:1788587942.860571:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f38181ed80 x1875470043931136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587942.860579:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875470043931136:0@lo:400:kworker.0 00000100:00100000:0.0:1788587942.860728:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:475e03e7-2028-419a-a63d-caf8ec05d538:3303:1875470043930880:0@lo:400:kworker.0 00000100:00080000:1.0:1788587942.860938:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788587942.984581:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788587943.625474:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587944.648035:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788587945.148548:0:15775:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788587945.148552:0:15775:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788587945.149894:0:15775:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88f4bf84e000 00000020:01000004:3.0:1788587945.149912:0:15775:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788587945.149928:0:15775:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788587945.149944:0:15775:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff88f485698000) 00000020:00000080:3.0:1788587945.149959:0:15775:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788587945.193907:0:15775:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788587945.194282:0:15775:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788587945.198084:0:15775:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788587945.198340:0:15775:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788587945.199754:0:15775:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788587945.201415:0:15775:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 493: rc = 0 00100000:10000000:3.0:1788587945.201724:0:15775:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 493: rc = 0 00100000:10000000:3.0:1788587945.201840:0:15775:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 493: rc = 0 00100000:10000000:3.0:1788587945.203114:0:15775:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 294: rc = 0 00100000:10000000:3.0:1788587945.204486:0:15775:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 294: rc = 0 00100000:10000000:3.0:1788587945.206115:0:15775:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 294: rc = 0 00100000:10000000:3.0:1788587945.206367:0:15775:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 294: rc = 0 00100000:10000000:3.0:1788587945.207244:0:15775:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 294: rc = 0 00100000:10000000:3.0:1788587945.207762:0:15775:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 294: rc = 0 00000020:00000080:3.0:1788587945.208486:0:15775:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788587945.208498:0:15775:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788587945.208578:0:15775:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa13e120d54ca9445 00000020:01000004:3.0:1788587945.208587:0:15775:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788587945.208685:0:15775:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.133@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788587945.208688:0:15775:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788587945.208694:0:15775:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788587945.208715:0:15775:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788587945.208719:0:15775:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.133@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788587945.218731:0:15775:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.133@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788587945.218768:0:15775:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.133@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788587945.218773:0:15775:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788587945.218775:0:15775:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587945.218777:0:15775:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587945.218778:0:15775:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587945.218779:0:15775:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587945.218780:0:15775:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587945.218782:0:15775:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587945.218784:0:15775:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587945.218785:0:15775:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788587945.218788:0:15775:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788587945.218791:0:15775:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587945.218792:0:15775:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587945.218793:0:15775:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587945.218794:0:15775:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587945.218795:0:15775:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587945.218796:0:15775:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587945.218797:0:15775:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587945.218798:0:15775:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587945.218799:0:15775:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788587945.218829:0:15775:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788587945.219084:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043931264:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788587945.219157:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587945.219221:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f493590780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587945.219277:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043931264 00000100:00100000:0.0:1788587945.219285:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043931264 00000100:00100000:0.0:1788587945.219345:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788587945.219354:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+16:15775:x1875470043931264:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788587945.219381:0:14370:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788587945.219384:0:14370:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788587945.219387:0:14370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788587945.227442:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+16:15775:x1875470043931264:12345-0@lo:253:mount.lustre.0 Request processed in 8079us (8274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587945.227457:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788587945.231590:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043931264:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788587945.231620:0:15775:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788587945.231623:0:15775:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788587945.231625:0:15775:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788587945.231627:0:15775:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587945.231628:0:15775:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587945.231629:0:15775:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587945.231631:0:15775:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587945.231632:0:15775:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587945.231634:0:15775:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587945.231635:0:15775:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788587945.231655:0:15775:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88f4bf84e000 from lustre-OST0001 10000000:01000000:2.0:1788587945.231692:0:15775:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788587945.231695:0:15775:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788587945.231702:0:15775:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88f4870299c0 local copy 00010000:00010000:2.0:1788587945.231713:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77a400/0xa13e120d54ca92b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92bd expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587945.231975:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382305500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043931392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587945.232041:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587945.232079:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4857a0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587945.232285:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043931392 00000100:00100000:3.0:1788587945.232291:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043931392 00000100:00100000:3.0:1788587945.232344:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788587945.232353:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+16:15775:x1875470043931392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587945.232592:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+16:15775:x1875470043931392:12345-0@lo:501:mount.lustre.0 Request processed in 239us (549us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587945.232600:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788587945.232878:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382305500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043931392:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788587945.232894:0:15775:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788587945.233046:0:15775:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788587945.233053:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77a400/0xa13e120d54ca92b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92bd expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.233072:0:15775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4bf77a400/0xa13e120d54ca92b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca92bd expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587945.233095:0:15775:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88f4bf84e000 10000000:01000000:1.0:1788587945.233099:0:15775:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788587945.233103:0:15775:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788587945.233105:0:15775:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788587945.233109:0:15775:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788587945.233111:0:15775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788587945.233132:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4856c0800/0xa13e120d54ca944c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.233139:0:15775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4856c0800/0xa13e120d54ca944c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.233147:0:15775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4856c0800/0xa13e120d54ca944c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587945.233161:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043931520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788587945.233201:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.233224:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4811ca9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587945.233716:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043931520 00000100:00100000:2.0:1788587945.233721:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043931520 00000100:00100000:2.0:1788587945.233763:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788587945.233770:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+16:15775:x1875470043931520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587945.233780:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587945.233792:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c159d200/0xa13e120d54ca9453 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca944c expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587945.233814:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159d200/0xa13e120d54ca9453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca944c expref: 17 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587945.233824:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c159d200/0xa13e120d54ca9453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca944c expref: 17 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587945.233832:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d200, rc 0) 00000100:00100000:2.0:1788587945.233887:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+17:15775:x1875470043931520:12345-0@lo:101:mount.lustre.0 Request processed in 116us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587945.233893:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788587945.234256:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043931520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587945.234271:0:15775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4856c0800/0xa13e120d54ca944c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9453 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.234281:0:15775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4856c0800/0xa13e120d54ca944c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca9453 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587945.235828:0:15775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788587945.237350:0:15775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587945.237969:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788587945.238028:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788587945.238064:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788587945.238113:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788587945.238151:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788587945.238259:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788587945.238328:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788587945.238336:0:15775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788587945.238417:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043931648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587945.238478:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.238758:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4811ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1788587945.239069:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043931648 00000100:00100000:2.0:1788587945.239076:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043931648 00000100:00100000:2.0:1788587945.239163:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788587945.239182:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+17:15775:x1875470043931648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587945.239618:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+17:15775:x1875470043931648:12345-0@lo:501:mount.lustre.0 Request processed in 446us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587945.239626:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788587945.239990:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043931648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587945.240044:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043931776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587945.240087:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.240120:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4811ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1788587945.240227:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043931776 00000100:00100000:2.0:1788587945.240233:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043931776 00000100:00100000:2.0:1788587945.240270:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788587945.240277:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+17:15775:x1875470043931776:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587945.241102:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+17:15775:x1875470043931776:12345-0@lo:503:mount.lustre.0 Request processed in 823us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587945.241111:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788587945.241252:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043931776:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788587945.242353:0:15775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587945.242433:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043931904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587945.242484:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.242741:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488f37c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587945.242807:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043931904 00000100:00100000:3.0:1788587945.242813:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043931904 00000100:00100000:3.0:1788587945.245741:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788587945.245765:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+17:15775:x1875470043931904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587945.251139:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+17:15775:x1875470043931904:12345-0@lo:502:mount.lustre.0 Request processed in 5375us (8644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587945.251154:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788587945.252025:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043931904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587945.252299:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788587945.252349:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788587945.252392:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788587945.252444:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788587945.252479:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788587945.252696:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788587945.252750:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788587945.252785:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788587945.252832:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788587945.253172:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587945.253241:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587945.253366:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043932032 00000100:00100000:3.0:1788587945.253373:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043932032 00000100:00100000:1.0:1788587945.253410:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488f37c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587945.253428:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788587945.253439:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+17:15775:x1875470043932032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587945.254029:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+17:15775:x1875470043932032:12345-0@lo:502:mount.lustre.0 Request processed in 589us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587945.254038:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788587945.254137:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587945.254225:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788587945.254237:0:15775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788587945.255312:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788587945.255321:0:15776:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788587945.255326:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587945.255328:0:15776:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788587945.255334:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788587945.255348:0:15776:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff88f4c19199c0) 00000020:00000080:2.0:1788587945.255368:0:15776:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788587945.255374:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788587945.255446:0:15776:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88f4bf84e000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788587945.255454:0:15776:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788587945.255461:0:15776:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa13e120d54ca9461 00010000:00010000:2.0:1788587945.260269:0:15776:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788587945.260941:0:15776:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788587945.263224:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788587945.264920:0:15776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788587945.264931:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587945.264938:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587945.264940:0:15776:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788587945.264943:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587945.264947:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587945.264948:0:15776:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788587945.264951:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788587945.264953:0:15776:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788587945.264955:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587945.264958:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587945.264959:0:15776:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788587945.264962:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587945.264964:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587945.264965:0:15776:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788587945.264968:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788587945.265036:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587945.265040:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587945.265041:0:15776:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788587945.265044:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788587945.265241:0:15775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788587945.265270:0:15775:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788587945.265293:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4856c0800/0xa13e120d54ca944c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9453 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587945.265306:0:15775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4856c0800/0xa13e120d54ca944c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9453 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587945.265329:0:15775:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f4bf84e000 from 1 10000000:01000000:3.0:1788587945.265332:0:15775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587945.265363:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587945.265370:0:15775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587945.265381:0:15775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587945.265403:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587945.265462:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587945.265758:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f489567d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587945.268025:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043932160 00000100:00100000:2.0:1788587945.268036:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043932160 00000100:00100000:2.0:1788587945.268085:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788587945.268095:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+17:15775:x1875470043932160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587945.268110:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587945.268137:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca946f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca9468 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587945.268278:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca946f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca9468 expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587945.268290:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca946f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca9468 expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587945.268307:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159d800, rc 0) 00000100:00100000:2.0:1788587945.268379:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+18:15775:x1875470043932160:12345-0@lo:101:mount.lustre.0 Request processed in 286us (2917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587945.268386:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788587945.268650:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587945.268670:0:15775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca946f expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.268681:0:15775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca946f expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587945.269198:0:15775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788587945.269477:0:15775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587945.269736:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788587945.269780:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788587945.269838:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788587945.269864:0:15775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788587945.269923:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587945.269970:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.270021:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488f37a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587945.270130:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043932288 00000100:00100000:2.0:1788587945.270137:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043932288 00000100:00100000:2.0:1788587945.270695:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788587945.270706:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f483796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+18:15775:x1875470043932288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587945.272946:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f483796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+18:15775:x1875470043932288:12345-0@lo:501:mount.lustre.0 Request processed in 2236us (2969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587945.272958:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788587945.274168:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587945.274226:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587945.274295:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.274328:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488f37a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587945.274783:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043932416 00000100:00100000:0.0:1788587945.274790:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043932416 00000100:00100000:0.0:1788587945.274832:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788587945.274859:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f483794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+18:15775:x1875470043932416:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587945.275101:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f483794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+18:15775:x1875470043932416:12345-0@lo:503:mount.lustre.0 Request processed in 261us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587945.275109:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788587945.275202:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932416:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788587945.276879:0:15775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587945.276949:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587945.277019:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.277057:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488f37a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587945.277345:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043932544 00000100:00100000:2.0:1788587945.277351:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043932544 00000100:00100000:2.0:1788587945.277400:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788587945.277408:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f483796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+18:15775:x1875470043932544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587945.277913:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f483796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+18:15775:x1875470043932544:12345-0@lo:502:mount.lustre.0 Request processed in 505us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587945.277920:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788587945.278048:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587945.278276:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788587945.278318:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788587945.278359:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788587945.278387:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788587945.278412:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788587945.278450:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788587945.278483:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788587945.279908:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788587945.279960:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587945.280041:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.280079:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488f37a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587945.280578:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043932672 00000100:00100000:0.0:1788587945.280586:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043932672 00000100:00100000:0.0:1788587945.280763:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788587945.280772:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+18:15775:x1875470043932672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587945.281028:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+18:15775:x1875470043932672:12345-0@lo:502:mount.lustre.0 Request processed in 257us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587945.281045:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788587945.281391:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587945.281686:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788587945.281701:0:15775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788587945.283146:0:15780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587945.283157:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587945.283159:0:15780:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788587945.283166:0:15780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88f4bf84e000 00000020:00000080:1.0:1788587945.283169:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587945.283187:0:15780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587945.283191:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587945.283192:0:15780:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788587945.283194:0:15780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587945.283196:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587945.283198:0:15780:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788587945.283201:0:15780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88f4bf84e000 00000020:00000080:1.0:1788587945.283203:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587945.283288:0:15780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587945.283291:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587945.283293:0:15780:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788587945.283295:0:15780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587945.283298:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587945.283299:0:15780:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788587945.283302:0:15780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88f4bf84e000 00000020:00000080:1.0:1788587945.283304:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587945.286930:0:15780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587945.286941:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587945.286944:0:15780:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788587945.286948:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788587945.287143:0:15775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788587945.287174:0:15775:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587945.287196:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca946f expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587945.287208:0:15775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca946f expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587945.287261:0:15775:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788587945.287264:0:15775:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88f4bf84e000 10000000:01000000:0.0:1788587945.287267:0:15775:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88f4bf84e000 10000000:01000000:0.0:1788587945.287271:0:15775:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587945.287275:0:15775:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88f4bf84e000 from 1 10000000:01000000:0.0:1788587945.287278:0:15775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788587945.287310:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b600/0xa13e120d54ca9476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587945.287319:0:15775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b600/0xa13e120d54ca9476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587945.287330:0:15775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b600/0xa13e120d54ca9476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587945.287354:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932800:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587945.287416:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587945.287460:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f487070540 going to sleep for 11 seconds 00000100:00100000:2.0:1788587945.287758:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043932800 00000100:00100000:2.0:1788587945.287766:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043932800 00000100:00100000:2.0:1788587945.287803:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788587945.287812:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+18:15775:x1875470043932800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587945.287823:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587945.287835:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4c159dc00/0xa13e120d54ca947d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca9476 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587945.287938:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4c159dc00/0xa13e120d54ca947d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca9476 expref: 19 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587945.287948:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4c159dc00/0xa13e120d54ca947d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca9476 expref: 19 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587945.287957:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4c159dc00, rc 0) 00000100:00100000:2.0:1788587945.288100:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+19:15775:x1875470043932800:12345-0@lo:101:mount.lustre.0 Request processed in 288us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587945.288107:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587945.289449:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587945.289473:0:15775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b600/0xa13e120d54ca9476 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca947d expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.289484:0:15775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b600/0xa13e120d54ca9476 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca947d expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587945.290383:0:15775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788587945.292442:0:15775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587945.293876:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788587945.293958:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788587945.294020:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788587945.294091:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788587945.294142:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788587945.294224:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788587945.294278:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788587945.294331:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788587945.294398:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788587945.294470:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788587945.294521:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788587945.294587:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788587945.294624:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788587945.294658:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788587945.296793:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788587945.296898:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788587945.296957:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788587945.297281:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788587945.297334:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788587945.297377:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788587945.297430:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788587945.297480:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788587945.297533:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788587945.298258:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788587945.298308:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788587945.298345:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788587945.298387:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788587945.298417:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788587945.298446:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788587945.298507:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788587945.298541:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788587945.298662:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788587945.298780:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788587945.298866:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788587945.298914:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788587945.298965:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788587945.299025:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788587945.299200:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788587945.299209:0:15775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788587945.299306:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587945.299365:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.299414:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043932928 00000100:00100000:1.0:1788587945.299420:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043932928 00000100:00100000:1.0:1788587945.299460:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788587945.299469:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+19:15775:x1875470043932928:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587945.299953:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+19:15775:x1875470043932928:12345-0@lo:501:mount.lustre.0 Request processed in 483us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587945.299961:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788587945.300019:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488f37300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587945.300041:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043932928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587945.300149:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043933056:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587945.300189:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.300213:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488f37300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587945.301798:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043933056 00000100:00100000:2.0:1788587945.301808:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043933056 00000100:00100000:2.0:1788587945.302736:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788587945.302748:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+19:15775:x1875470043933056:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587945.303067:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+19:15775:x1875470043933056:12345-0@lo:503:mount.lustre.0 Request processed in 321us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587945.303075:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788587945.303319:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043933056:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788587945.304881:0:15775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587945.304951:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043933184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587945.305027:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.305063:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488f37300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587945.305179:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043933184 00000100:00100000:0.0:1788587945.305185:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043933184 00000100:00100000:0.0:1788587945.305230:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788587945.305237:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+19:15775:x1875470043933184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587945.305489:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+19:15775:x1875470043933184:12345-0@lo:502:mount.lustre.0 Request processed in 252us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587945.305497:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788587945.305816:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043933184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587945.306285:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788587945.306337:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788587945.306383:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788587945.306429:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788587945.306463:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788587945.306693:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788587945.306736:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788587945.306770:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788587945.306817:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788587945.307063:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788587945.307100:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788587945.307155:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788587945.307189:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788587945.307217:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788587945.307270:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788587945.307679:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788587945.307719:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788587945.307769:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788587945.307804:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788587945.307837:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788587945.308001:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788587945.308051:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788587945.308084:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788587945.308129:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788587945.308164:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788587945.308195:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788587945.308238:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788587945.308271:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788587945.308302:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788587945.308348:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788587945.308398:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788587945.308431:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788587945.308462:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788587945.308709:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788587945.308746:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788587945.308805:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788587945.308941:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788587945.308984:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788587945.309059:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788587945.309099:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788587945.309145:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043933312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587945.309219:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.309313:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488f37300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587945.309357:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043933312 00000100:00100000:2.0:1788587945.309364:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043933312 00000100:00100000:2.0:1788587945.309451:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788587945.309461:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+19:15775:x1875470043933312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587945.309700:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+19:15775:x1875470043933312:12345-0@lo:502:mount.lustre.0 Request processed in 240us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587945.309708:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788587945.309875:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043933312:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587945.309950:0:15775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788587945.309960:0:15775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788587945.310695:0:15785:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788587945.310711:0:15785:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88f48709cd40) 00000020:00000080:1.0:1788587945.310732:0:15785:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788587945.310804:0:15785:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88f4bf84e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788587945.310808:0:15785:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88f4bf84e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788587945.310811:0:15785:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88f4bf84e000 3 00010000:00080000:1.0:1788587945.310861:0:15785:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88f4857c7800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.133@tcp at head 00010000:00010000:1.0:1788587945.312456:0:15785:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788587945.314076:0:15785:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788587945.314113:0:15785:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788587945.314124:0:15785:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa13e120d54ca948b 00000100:00080000:0.0:1788587945.314133:0:15785:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788587945.314139:0:15785:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88f4857c7800 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:0.0:1788587945.314172:0:15785:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f38181ed80 x1875470043933440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587945.314196:0:15785:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788587945.314279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587945.314283:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587945.314293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587945.314296:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587945.314341:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043933696:0@lo:400:kworker.0 00000100:00100000:2.0:1788587945.314398:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.314423:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043933696 00000100:00100000:1.0:1788587945.314430:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043933696 00000100:00100000:2.0:1788587945.314433:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587945.314438:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043933568:0@lo:400:kworker.0 00000100:00100000:2.0:1788587945.314458:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587945.314494:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875470043933440:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788587945.314525:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587945.318247:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587945.318265:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043933696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587945.318353:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043933696:12345-0@lo:400:kworker.0 Request processed in 95us (3955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587945.318361:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1788587945.318414:0:15785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:2.0:1788587945.318418:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f382304e00 x1875470043933696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587945.318431:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043933696:0@lo:400:kworker.0 00000100:00100000:1.0:1788587945.318478:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043933568 00000100:00100000:1.0:1788587945.318486:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043933568 00000100:00100000:0.0:1788587945.318551:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043933440 00000100:00100000:0.0:1788587945.318556:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043933440 00000100:00100000:0.0:1788587945.318593:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587945.318598:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875470043933440:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788587945.318620:0:14374:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 392 last 0 00000020:00000080:0.0:1788587945.318652:0:14374:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa13e120d54ca9492 00000004:00100000:0.0:1788587945.318666:0:14374:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788587945.318693:0:14374:0:(import.c:65:import_set_state_nolock()) ffff88f4b51f3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587945.318743:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875470043933440:12345-0@lo:38:llog_process_th.0 Request processed in 144us (4218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587945.318750:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587945.318924:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587945.318936:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043933568:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788587945.318942:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:1.0:1788587945.318964:0:15775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:0.0:1788587945.318979:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043933568:12345-0@lo:400:kworker.0 Request processed in 45us (4520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587945.318985:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 10000000:01000000:1.0:1788587945.318996:0:15775:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00080000:3.0:1788587945.319178:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f38181ed80 x1875470043933440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587945.319188:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788587945.319194:0:3301:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788587945.319201:0:3301:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00010000:00080000:2.0:1788587945.319201:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88f382306d80 x1875470043933568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587945.319206:0:3301:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788587945.319208:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4857c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788587945.319210:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043933568:0@lo:400:kworker.0 00000100:00100000:3.0:1788587945.319213:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875470043933440:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1788587945.319249:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b600/0xa13e120d54ca9476 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca947d expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.319260:0:15775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4bf77b600/0xa13e120d54ca9476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca947d expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788587945.319303:0:15775:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788587945.319305:0:15775:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788587945.319307:0:15775:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587945.319308:0:15775:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587945.319309:0:15775:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587945.319311:0:15775:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587945.319312:0:15775:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587945.319314:0:15775:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587945.319315:0:15775:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788587945.319320:0:15775:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788587945.319322:0:15775:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788587945.319323:0:15775:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788587945.319324:0:15775:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587945.319325:0:15775:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587945.319326:0:15775:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587945.319327:0:15775:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587945.319328:0:15775:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587945.319329:0:15775:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587945.319330:0:15775:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788587945.319346:0:15775:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788587945.319360:0:15775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043933824:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788587945.319395:0:15775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.319459:0:15775:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f488f37a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587945.319563:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043933824 00000100:00100000:0.0:1788587945.319568:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043933824 00000100:00100000:0.0:1788587945.319689:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788587945.319698:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+19:15775:x1875470043933824:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788587945.319728:0:14370:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788587945.319739:0:14370:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788587945.339965:0:14370:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788587945.339978:0:14370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788587945.340021:0:14390:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788587945.340026:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788587945.340047:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.340066:0:14390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4bf77a600/0xa13e120d54ca9437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca9430 expref: 19 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.340074:0:14390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.340124:0:14390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4bf77a600/0xa13e120d54ca9437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca9430 expref: 19 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.340137:0:14390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f4bf77a600/0xa13e120d54ca9437 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca9430 expref: 19 pid: 14367 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587945.340150:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14390:1875470043933952:0@lo:104: 00000100:00100000:1.0:1788587945.340209:0:14390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.340247:0:14390:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f382cb4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587945.340276:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043933952 00000100:00100000:1.0:1788587945.340283:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043933952 00000100:00100000:1.0:1788587945.340326:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587945.340335:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:475e03e7-2028-419a-a63d-caf8ec05d538+3:14390:x1875470043933952:12345-0@lo:104: 00010000:00010000:1.0:1788587945.340347:0:14359:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca9437 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.340393:0:14359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788587945.340398:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:475e03e7-2028-419a-a63d-caf8ec05d538+3:14390:x1875470043933952:12345-0@lo:104: Request processed in 66us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587945.340405:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788587945.340427:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587945.340433:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca9437 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.340440:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159de00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:1.0:1788587945.340443:0:14363:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca9437 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.340464:0:14363:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca9437 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587945.340470:0:14363:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca9437 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587945.340476:0:14363:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788587945.341021:0:14363:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca9437 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.341029:0:14363:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788587945.341083:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1788587945.341105:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca9437 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.341113:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f4c159de00/0xa13e120d54ca9430 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca9437 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.341129:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587945.341131:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587945.341133:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587945.341168:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14390:1875470043933952:0@lo:104: 00010000:00010000:1.0:1788587945.341186:0:14390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587945.342084:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:475e03e7-2028-419a-a63d-caf8ec05d538:3305:1875470043934080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587945.342135:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587945.342258:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043934080 00000100:00100000:1.0:1788587945.342264:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043934080 00010000:00010000:1.0:1788587945.342289:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4bf77a600/0xa13e120d54ca9437 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca9430 expref: 20 pid: 14367 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587945.342353:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587945.342368:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:475e03e7-2028-419a-a63d-caf8ec05d538+20:3305:x1875470043934080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587945.342380:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587945.342385:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4bf77a600/0xa13e120d54ca9437 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca9430 expref: 20 pid: 14367 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.342396:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4bf77a600/0xa13e120d54ca9437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca9430 expref: 20 pid: 14367 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.342412:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4bf77a600/0xa13e120d54ca9437 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca9430 expref: 20 pid: 14367 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.342426:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.342434:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788587945.342448:0:14362:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002422772s 00010000:00010000:1.0:1788587945.342453:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.342460:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.342467:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.342474:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.342479:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1200 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587945.342489:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.342510:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.342530:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587945.342539:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587945.342576:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:475e03e7-2028-419a-a63d-caf8ec05d538+19:3305:x1875470043934080:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587945.342583:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788587945.342938:0:14390:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587945.342948:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587945.342954:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca9499 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587945.343968:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:475e03e7-2028-419a-a63d-caf8ec05d538:3305:1875470043934080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587945.352912:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+18:15775:x1875470043933824:12345-0@lo:253:mount.lustre.0 Request processed in 33207us (33507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587945.352927:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788587945.353063:0:15775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:475e03e7-2028-419a-a63d-caf8ec05d538:15775:1875470043933824:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788587945.353079:0:15775:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788587945.353082:0:15775:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788587945.353084:0:15775:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788587945.353085:0:15775:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587945.353086:0:15775:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587945.353097:0:15775:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587945.353098:0:15775:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587945.353099:0:15775:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587945.353101:0:15775:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587945.353102:0:15775:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788587945.353116:0:15775:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788587945.360479:0:15775:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788587945.360727:0:15775:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587945.361222:0:15775:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587945.361368:0:15775:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587945.361492:0:15775:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587945.361797:0:15775:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788587945.362429:0:15775:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788587945.409042:0:15775:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788587945.409051:0:15775:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788587945.409084:0:15775:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788587945.409134:0:15775:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.133@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788587945.409156:0:15775:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788587945.409182:0:15775:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788587945.672922:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587946.377358:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587930/real 1788587930] req@ffff88f4bf76c700 x1875470043926912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587945 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587946.377385:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88f4bf76c700 x1875470043926912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587945 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587946.377396:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587930/real 1788587930] req@ffff88f4bf76c000 x1875470043927040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587945 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587946.377407:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88f4bf76c000 x1875470043927040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587945 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587946.377424:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4afd98800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587946.377435:0:3301:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788587946.377450:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043926912:0@lo:8:kworker.0 00000100:00080000:1.0:1788587946.377456:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f48661c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587946.377461:0:3301:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788587946.377464:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043927040:0@lo:8:kworker.0 00000100:00080000:2.0:1788587946.377615:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587946.377619:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788587946.377621:0:36:0:(import.c:65:import_set_state_nolock()) ffff88f4afd98800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587946.377626:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 377 00000100:00080000:2.0:1788587946.377631:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788587946.377636:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88f4afd98800 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:2.0:1788587946.377654:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f382304e00 x1875470043934336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587946.377664:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587946.377666:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788587946.377668:0:36:0:(import.c:65:import_set_state_nolock()) ffff88f48661c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587946.377670:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 377 00000100:00080000:2.0:1788587946.377673:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788587946.377676:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88f48661c000 using connection 192.168.206.133@tcp/0@lo 00000100:00100000:2.0:1788587946.377684:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88f382304700 x1875470043934464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587946.377751:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:475e03e7-2028-419a-a63d-caf8ec05d538:3305:1875470043934208:0@lo:400:kworker.0 00000100:00100000:2.0:1788587946.377911:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587946.377956:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587946.377962:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043934848:0@lo:400:kworker.0 00000100:00100000:2.0:1788587946.377993:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587946.378033:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043934592:0@lo:400:kworker.0 00000100:00100000:2.0:1788587946.378057:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587946.378076:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587946.378081:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043934720:0@lo:400:kworker.0 00000100:00100000:2.0:1788587946.378101:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587946.378130:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043934208 00000100:00100000:2.0:1788587946.378137:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043934208 00000100:00100000:2.0:1788587946.378174:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788587946.378182:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+18:3305:x1875470043934208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587946.378220:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+18:3305:x1875470043934208:12345-0@lo:400:kworker.0 Request processed in 38us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587946.378226:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788587946.378252:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043934848 00000100:00100000:2.0:1788587946.378255:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043934848 00000100:00100000:2.0:1788587946.378280:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043934592 00000100:00100000:2.0:1788587946.378282:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043934592 00000100:00100000:2.0:1788587946.378291:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043934720 00000100:00100000:2.0:1788587946.378294:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043934720 00000100:00100000:2.0:1788587946.378304:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587946.378309:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043934848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587946.378338:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043934848:12345-0@lo:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587946.378351:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587946.378362:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587946.378368:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043934592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587946.378397:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043934592:12345-0@lo:400:kworker.0 Request processed in 30us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587946.378402:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587946.378411:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587946.378416:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043934720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587946.378436:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043934720:12345-0@lo:400:kworker.0 Request processed in 21us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587946.378442:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788587946.378472:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f382307480 x1875470043934720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587946.378482:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043934720:0@lo:400:kworker.0 00010000:00080000:2.0:1788587946.378490:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f382304a80 x1875470043934592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587946.378769:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788587946.378922:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f382307800 x1875470043934848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587946.378932:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043934848:0@lo:400:kworker.0 00000100:00100000:3.0:1788587946.378940:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:475e03e7-2028-419a-a63d-caf8ec05d538:3305:1875470043934208:0@lo:400:kworker.0 00000100:00100000:1.0:1788587946.379042:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043934336:0@lo:8:kworker.0 00000100:00100000:1.0:1788587946.379077:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587946.379108:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043934464:0@lo:8:kworker.0 00000100:00100000:1.0:1788587946.379129:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587946.379163:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043934336 00000100:00100000:1.0:1788587946.379166:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043934336 00000100:00100000:1.0:1788587946.379184:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043934464 00000100:00100000:1.0:1788587946.379186:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043934464 00000100:00100000:1.0:1788587946.379195:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587946.379200:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1875470043934336:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788587946.379221:0:15061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 393 last 0 00000020:00000080:1.0:1788587946.379265:0:15061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13e120d54ca94a0 00002000:00100000:1.0:1788587946.379279:0:15061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88f48ebb1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788587946.379283:0:15061:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788587946.379286:0:15061:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788587946.379639:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043934592:0@lo:400:kworker.0 00002000:00080000:1.0:1788587946.380132:0:15061:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788587946.380157:0:15061:0:(import.c:65:import_set_state_nolock()) ffff88f48ebb6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587946.380578:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875470043934336:12345-0@lo:8:kworker.0 Request processed in 1375us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587946.380586:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587946.380607:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587946.380622:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1875470043934464:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788587946.380641:0:15061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 393 last 0 00000020:00000080:1.0:1788587946.380664:0:15061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13e120d54ca94a7 00002000:00100000:1.0:1788587946.380674:0:15061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff88f48ebb4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788587946.380678:0:15061:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788587946.380680:0:15061:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788587946.381077:0:15061:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788587946.381094:0:15061:0:(import.c:65:import_set_state_nolock()) ffff88f48ebb5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587946.381128:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875470043934464:12345-0@lo:8:kworker.0 Request processed in 506us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587946.381135:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788587946.381349:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f382304e00 x1875470043934336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587946.381360:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587946.381366:0:3301:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788587946.381373:0:3301:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788587946.381377:0:3301:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788587946.381385:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f4afd98800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788587946.381458:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788587946.381464:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043934336:0@lo:8:kworker.0 00010000:00080000:2.0:1788587946.381482:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f382304700 x1875470043934464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587946.381500:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587946.381504:0:3301:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788587946.381509:0:3301:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788587946.381512:0:3301:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788587946.381515:0:3301:0:(import.c:65:import_set_state_nolock()) ffff88f48661c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788587946.381534:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788587946.381538:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875470043934464:0@lo:8:kworker.0 00000004:00080000:1.0:1788587946.381675:0:14399:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788587946.381692:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14399:1875470043935104:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788587946.381725:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587946.381745:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f382cb4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587946.381762:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043935104 00000100:00100000:1.0:1788587946.381767:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043935104 00000100:00100000:1.0:1788587946.381803:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788587946.381823:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14399:x1875470043935104:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788587946.383610:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043934976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587946.383661:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587946.383925:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043934976 00000100:00100000:2.0:1788587946.383932:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043934976 00000100:00100000:2.0:1788587946.383969:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587946.383977:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875470043934976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587946.383996:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587946.384048:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875470043934976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587946.384055:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788587946.384089:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf76f480 x1875470043934976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587946.384107:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043934976:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788587946.384204:0:14397:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788587946.384226:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14397:1875470043935360:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788587946.384255:0:14397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587946.384274:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4918de540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587946.384288:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587946.384296:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043935232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587946.384317:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587946.384339:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043935232 00000100:00100000:3.0:1788587946.384342:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043935232 00000100:00100000:3.0:1788587946.384366:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587946.384372:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875470043935232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587946.384391:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587946.384423:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875470043935232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587946.384428:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788587946.384451:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bab64e00 x1875470043935232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587946.384463:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043935232:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788587946.384990:0:14396:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788587946.385303:0:14396:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 393640459552ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788587946.385334:0:14398:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788587946.385482:0:14398:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393640638456ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788587946.386946:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587946.386964:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1788587946.386985:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587946.386990:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1788587946.388256:0:15059:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788587946.388264:0:15059:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788587946.388268:0:15059:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00100000:0.0:1788587946.389036:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587946.389047:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043935360 00000100:00100000:0.0:1788587946.389055:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043935360 00000100:00100000:0.0:1788587946.389171:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587946.389182:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14397:x1875470043935360:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788587946.391614:0:15850:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788587946.391622:0:15850:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788587946.391626:0:15850:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1788587946.398460:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587946.398473:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df0b4bdd/0xa13e120d54ca94ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.399650:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1788587946.399655:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587946.399662:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df0b4bdd/0xa13e120d54ca94ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.399684:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df0b4bdd/0xa13e120d54ca94ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.399695:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df0b4bdd/0xa13e120d54ca94ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.399703:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df0b4bdd/0xa13e120d54ca94ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.399721:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587946.400256:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587946.400263:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa42fd1f/0xa13e120d54ca94b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400272:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1788587946.400276:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587946.400281:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa42fd1f/0xa13e120d54ca94b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400290:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa42fd1f/0xa13e120d54ca94b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400309:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa42fd1f/0xa13e120d54ca94b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400317:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa42fd1f/0xa13e120d54ca94b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400332:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788587946.400343:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587946.400349:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df0b4bdd/0xa13e120d54ca94ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400356:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0600 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587946.400361:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df0b4bdd/0xa13e120d54ca94ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400371:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df0b4bdd/0xa13e120d54ca94ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400386:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df0b4bdd/0xa13e120d54ca94ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400393:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df0b4bdd/0xa13e120d54ca94ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400410:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587946.400419:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa42fd1f/0xa13e120d54ca94b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400426:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1800 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587946.400429:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa42fd1f/0xa13e120d54ca94b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400437:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa42fd1f/0xa13e120d54ca94b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400446:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa42fd1f/0xa13e120d54ca94b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400454:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa42fd1f/0xa13e120d54ca94b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.400467:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587946.400469:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587946.400470:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.400607:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587946.406958:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.406969:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e8354d9/0xa13e120d54ca94bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.406984:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.406989:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.406996:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e8354d9/0xa13e120d54ca94bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.407043:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e8354d9/0xa13e120d54ca94bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.407054:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e8354d9/0xa13e120d54ca94bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.407062:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e8354d9/0xa13e120d54ca94bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.407093:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788587946.407635:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.407644:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070cfd63b/0xa13e120d54ca94c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.407653:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.407656:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.407660:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070cfd63b/0xa13e120d54ca94c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.407670:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070cfd63b/0xa13e120d54ca94c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.407679:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070cfd63b/0xa13e120d54ca94c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.407686:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070cfd63b/0xa13e120d54ca94c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.407698:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788587946.408226:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.408232:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca94ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.408240:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.408248:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.408253:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca94ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.408263:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca94ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.408271:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca94ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.408278:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca94ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.408286:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788587946.408614:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788587946.408622:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e8354d9/0xa13e120d54ca94bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408629:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.408633:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e8354d9/0xa13e120d54ca94bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408641:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e8354d9/0xa13e120d54ca94bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408660:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e8354d9/0xa13e120d54ca94bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408667:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e8354d9/0xa13e120d54ca94bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408686:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587946.408689:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070cfd63b/0xa13e120d54ca94c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408695:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77bc00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.408698:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070cfd63b/0xa13e120d54ca94c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408706:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070cfd63b/0xa13e120d54ca94c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408722:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070cfd63b/0xa13e120d54ca94c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408729:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070cfd63b/0xa13e120d54ca94c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408740:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.408743:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca94ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408750:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a200 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.408754:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca94ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408762:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca94ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408770:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca94ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408776:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e031a63d/0xa13e120d54ca94ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.408788:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.408790:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.408796:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.409332:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.409339:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca94d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.409349:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.409352:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.409357:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca94d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.409368:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca94d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.409375:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca94d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.409382:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca94d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.409398:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.409405:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.409409:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca94d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.409414:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159da00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.409417:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca94d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.409435:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca94d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.409446:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca94d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.409452:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca94d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.409464:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.409465:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.409466:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587946.409899:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.409905:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e1a2f15/0xa13e120d54ca94d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.409913:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.409917:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.409920:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e1a2f15/0xa13e120d54ca94d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.409928:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e1a2f15/0xa13e120d54ca94d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.409936:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e1a2f15/0xa13e120d54ca94d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.409949:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e1a2f15/0xa13e120d54ca94d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.409967:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.410149:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.410154:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e1a2f15/0xa13e120d54ca94d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410162:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77ae00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.410166:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e1a2f15/0xa13e120d54ca94d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410174:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e1a2f15/0xa13e120d54ca94d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410185:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e1a2f15/0xa13e120d54ca94d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410202:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e1a2f15/0xa13e120d54ca94d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410218:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.410220:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.410222:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.410696:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.410703:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca94df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410713:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.410716:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.410721:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca94df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410730:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca94df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410738:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca94df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410744:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca94df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410760:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.410768:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.410778:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca94df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410785:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c800 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.410788:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca94df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410795:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca94df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410806:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca94df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410815:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca94df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.410828:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.410830:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.410832:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587946.411446:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.411452:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9a98486/0xa13e120d54ca94e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.411462:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.411465:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.411470:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9a98486/0xa13e120d54ca94e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.411486:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9a98486/0xa13e120d54ca94e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.411495:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9a98486/0xa13e120d54ca94e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.411513:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9a98486/0xa13e120d54ca94e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.412361:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788587946.413226:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.413234:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac47f3f8/0xa13e120d54ca94ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.413253:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.413257:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.413263:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac47f3f8/0xa13e120d54ca94ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.413276:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac47f3f8/0xa13e120d54ca94ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.413286:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac47f3f8/0xa13e120d54ca94ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.413294:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac47f3f8/0xa13e120d54ca94ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.413303:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788587946.413671:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.413677:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c40217c/0xa13e120d54ca94f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.413685:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.413688:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.413692:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c40217c/0xa13e120d54ca94f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.413702:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c40217c/0xa13e120d54ca94f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.413720:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c40217c/0xa13e120d54ca94f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.413728:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c40217c/0xa13e120d54ca94f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.413735:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788587946.414415:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788587946.414423:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9a98486/0xa13e120d54ca94e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414432:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b400 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587946.414437:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9a98486/0xa13e120d54ca94e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414458:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9a98486/0xa13e120d54ca94e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414475:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9a98486/0xa13e120d54ca94e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414502:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9a98486/0xa13e120d54ca94e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414522:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587946.414526:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac47f3f8/0xa13e120d54ca94ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414533:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77ac00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587946.414536:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac47f3f8/0xa13e120d54ca94ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414544:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac47f3f8/0xa13e120d54ca94ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414554:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac47f3f8/0xa13e120d54ca94ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414561:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac47f3f8/0xa13e120d54ca94ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414585:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587946.414589:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c40217c/0xa13e120d54ca94f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414596:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77be00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587946.414599:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c40217c/0xa13e120d54ca94f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414607:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c40217c/0xa13e120d54ca94f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414617:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c40217c/0xa13e120d54ca94f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414623:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c40217c/0xa13e120d54ca94f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.414632:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587946.414634:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587946.414635:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.416117:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.416638:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.416647:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca94fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.416662:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.416666:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.416672:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca94fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.416696:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca94fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.416707:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca94fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.416714:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca94fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.416731:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587946.417238:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.417244:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca9502 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417254:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.417257:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.417262:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca9502 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417271:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca9502 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417279:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca9502 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417295:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca9502 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417307:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788587946.417315:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587946.417320:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca94fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417327:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159de00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.417332:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca94fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417342:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca94fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417357:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca94fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417364:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca94fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417381:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.417384:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca9502 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417401:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c600 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.417404:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca9502 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417412:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca9502 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417422:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca9502 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417429:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca9502 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417441:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.417443:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.417444:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.417836:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.417862:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca9509 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417872:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.417875:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.417879:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca9509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417888:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca9509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417902:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca9509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417909:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca9509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417921:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.417929:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.417933:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca9509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417939:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.417942:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca9509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417949:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca9509 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417959:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca9509 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417966:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca9509 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.417979:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.417986:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.417988:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.418375:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.418381:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca9510 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.418389:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.418392:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.418396:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca9510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.418405:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca9510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.418412:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca9510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.418420:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca9510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.418432:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.418440:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.418443:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca9510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.418450:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.418453:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca9510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.418472:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca9510 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.418483:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca9510 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.418490:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca9510 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.418504:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.418506:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.418507:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.418870:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.418876:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca9517 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.418884:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.418888:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.418892:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca9517 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.418901:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca9517 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.418909:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca9517 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.418921:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca9517 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587946.419308:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.419315:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca951e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.419323:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.419327:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.419331:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca951e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.419341:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca951e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.419348:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca951e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.419356:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca951e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.419739:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788587946.419761:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788587946.420235:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.420241:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000455e124c/0xa13e120d54ca9525 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.420252:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.420256:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.420261:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000455e124c/0xa13e120d54ca9525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.420271:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000455e124c/0xa13e120d54ca9525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.420278:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000455e124c/0xa13e120d54ca9525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.420286:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000455e124c/0xa13e120d54ca9525 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.420294:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788587946.420671:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.420677:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2dc21f3/0xa13e120d54ca952c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.420685:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.420694:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.420699:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2dc21f3/0xa13e120d54ca952c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.420709:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2dc21f3/0xa13e120d54ca952c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.420717:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2dc21f3/0xa13e120d54ca952c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.420724:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2dc21f3/0xa13e120d54ca952c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.420732:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788587946.421127:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.421133:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d22b871d/0xa13e120d54ca9533 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.421141:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.421144:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.421149:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d22b871d/0xa13e120d54ca9533 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.421158:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d22b871d/0xa13e120d54ca9533 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.421166:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d22b871d/0xa13e120d54ca9533 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.421179:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d22b871d/0xa13e120d54ca9533 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.421187:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788587946.421523:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.421528:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000927ac345/0xa13e120d54ca953a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.421537:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.421540:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.421544:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000927ac345/0xa13e120d54ca953a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.421553:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000927ac345/0xa13e120d54ca953a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.421561:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000927ac345/0xa13e120d54ca953a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.421568:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000927ac345/0xa13e120d54ca953a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.421576:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788587946.421975:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.421981:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008589d8fc/0xa13e120d54ca9541 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.421996:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.422013:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.422018:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008589d8fc/0xa13e120d54ca9541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.422027:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008589d8fc/0xa13e120d54ca9541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.422036:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008589d8fc/0xa13e120d54ca9541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.422044:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008589d8fc/0xa13e120d54ca9541 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.422052:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1788587946.422425:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.422430:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137aa745/0xa13e120d54ca9548 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.422438:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.422441:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.422444:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000137aa745/0xa13e120d54ca9548 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.422452:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000137aa745/0xa13e120d54ca9548 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.422469:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137aa745/0xa13e120d54ca9548 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.422475:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000137aa745/0xa13e120d54ca9548 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.422483:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1788587946.424468:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.424478:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef2dff69/0xa13e120d54ca954f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.424492:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.424496:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.424502:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef2dff69/0xa13e120d54ca954f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.424514:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef2dff69/0xa13e120d54ca954f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.424524:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef2dff69/0xa13e120d54ca954f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.424532:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef2dff69/0xa13e120d54ca954f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.424552:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1788587946.424969:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587946.425388:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788587946.425396:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca9517 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425405:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159ca00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587946.425416:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca9517 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425425:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca9517 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425441:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca9517 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425449:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca9517 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425469:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788587946.425473:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca951e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425480:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77b200 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587946.425483:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca951e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425496:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca951e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425505:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca951e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425511:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ff4c23c/0xa13e120d54ca951e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425532:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788587946.425535:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000455e124c/0xa13e120d54ca9525 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425541:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a600 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587946.425543:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000455e124c/0xa13e120d54ca9525 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425551:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000455e124c/0xa13e120d54ca9525 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425559:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000455e124c/0xa13e120d54ca9525 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425566:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000455e124c/0xa13e120d54ca9525 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425578:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788587946.425581:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2dc21f3/0xa13e120d54ca952c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425587:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce8e00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587946.425589:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2dc21f3/0xa13e120d54ca952c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425607:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2dc21f3/0xa13e120d54ca952c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425617:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2dc21f3/0xa13e120d54ca952c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425626:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2dc21f3/0xa13e120d54ca952c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425638:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788587946.425642:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d22b871d/0xa13e120d54ca9533 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425648:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587946.425651:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d22b871d/0xa13e120d54ca9533 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425657:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d22b871d/0xa13e120d54ca9533 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425666:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d22b871d/0xa13e120d54ca9533 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425674:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d22b871d/0xa13e120d54ca9533 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425694:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788587946.425697:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000927ac345/0xa13e120d54ca953a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425704:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9c00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587946.425706:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000927ac345/0xa13e120d54ca953a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425713:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000927ac345/0xa13e120d54ca953a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425721:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000927ac345/0xa13e120d54ca953a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425728:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000927ac345/0xa13e120d54ca953a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425738:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788587946.425741:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008589d8fc/0xa13e120d54ca9541 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425747:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce8600 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587946.425750:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008589d8fc/0xa13e120d54ca9541 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425766:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008589d8fc/0xa13e120d54ca9541 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425775:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008589d8fc/0xa13e120d54ca9541 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425782:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008589d8fc/0xa13e120d54ca9541 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425794:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587946.425797:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000137aa745/0xa13e120d54ca9548 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425803:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9a00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587946.425806:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000137aa745/0xa13e120d54ca9548 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425813:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000137aa745/0xa13e120d54ca9548 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425821:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000137aa745/0xa13e120d54ca9548 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425828:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000137aa745/0xa13e120d54ca9548 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425868:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587946.425871:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef2dff69/0xa13e120d54ca954f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425877:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9e00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:1.0:1788587946.425880:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef2dff69/0xa13e120d54ca954f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425888:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef2dff69/0xa13e120d54ca954f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425898:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef2dff69/0xa13e120d54ca954f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425905:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef2dff69/0xa13e120d54ca954f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587946.425915:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587946.425917:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587946.425919:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587946.426925:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baed8d5b/0xa13e120d54ca9556 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.426942:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.426946:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.426952:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baed8d5b/0xa13e120d54ca9556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.426964:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baed8d5b/0xa13e120d54ca9556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.427125:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baed8d5b/0xa13e120d54ca9556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.427136:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baed8d5b/0xa13e120d54ca9556 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.427284:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788587946.427812:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.427819:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015f3b35e/0xa13e120d54ca955d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.427829:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.427838:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.427866:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f3b35e/0xa13e120d54ca955d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.427876:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015f3b35e/0xa13e120d54ca955d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.427884:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015f3b35e/0xa13e120d54ca955d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.427891:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015f3b35e/0xa13e120d54ca955d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.427898:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788587946.429123:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587946.429132:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baed8d5b/0xa13e120d54ca9556 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429142:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9200 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.429147:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baed8d5b/0xa13e120d54ca9556 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429156:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baed8d5b/0xa13e120d54ca9556 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429173:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baed8d5b/0xa13e120d54ca9556 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429181:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baed8d5b/0xa13e120d54ca9556 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429200:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.429203:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015f3b35e/0xa13e120d54ca955d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429221:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce8800 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.429224:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015f3b35e/0xa13e120d54ca955d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429233:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015f3b35e/0xa13e120d54ca955d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429242:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015f3b35e/0xa13e120d54ca955d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429249:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015f3b35e/0xa13e120d54ca955d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429262:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.429263:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.429265:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.429752:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.429759:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca9564 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429769:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.429773:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.429779:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca9564 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429789:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca9564 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429802:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca9564 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429809:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca9564 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429826:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.429834:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.429837:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca9564 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429879:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159ce00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.429882:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca9564 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429890:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca9564 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429900:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca9564 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429907:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007099237a/0xa13e120d54ca9564 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.429921:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.429927:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.429929:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.430322:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.430328:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81faca1/0xa13e120d54ca956b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430337:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.430340:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.430344:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b81faca1/0xa13e120d54ca956b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430352:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b81faca1/0xa13e120d54ca956b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430359:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81faca1/0xa13e120d54ca956b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430365:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b81faca1/0xa13e120d54ca956b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430379:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.430387:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.430390:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b81faca1/0xa13e120d54ca956b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430397:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159cc00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.430400:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81faca1/0xa13e120d54ca956b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430419:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81faca1/0xa13e120d54ca956b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430430:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b81faca1/0xa13e120d54ca956b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430438:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b81faca1/0xa13e120d54ca956b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430452:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.430454:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.430456:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.430823:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.430829:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec09c50c/0xa13e120d54ca9572 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430837:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.430862:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.430867:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec09c50c/0xa13e120d54ca9572 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430877:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec09c50c/0xa13e120d54ca9572 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430885:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec09c50c/0xa13e120d54ca9572 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430899:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec09c50c/0xa13e120d54ca9572 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430912:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.430920:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.430924:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec09c50c/0xa13e120d54ca9572 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430931:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d400 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.430934:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec09c50c/0xa13e120d54ca9572 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430942:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec09c50c/0xa13e120d54ca9572 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430953:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec09c50c/0xa13e120d54ca9572 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430961:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec09c50c/0xa13e120d54ca9572 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.430975:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.430977:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.430979:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.431391:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.431403:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e031a63d/0xa13e120d54ca9579 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.431412:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.431415:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.431420:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e031a63d/0xa13e120d54ca9579 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.431430:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e031a63d/0xa13e120d54ca9579 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.431438:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e031a63d/0xa13e120d54ca9579 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.431445:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e031a63d/0xa13e120d54ca9579 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.431459:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.431467:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.431471:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e031a63d/0xa13e120d54ca9579 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.431478:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a200 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.431482:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e031a63d/0xa13e120d54ca9579 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.431490:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e031a63d/0xa13e120d54ca9579 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.431507:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e031a63d/0xa13e120d54ca9579 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.431515:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e031a63d/0xa13e120d54ca9579 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.431530:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.431532:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.431534:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587946.432163:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587946.432972:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:2.0:1788587946.434103:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.434114:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070cfd63b/0xa13e120d54ca9587 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.434129:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.434134:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.434140:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070cfd63b/0xa13e120d54ca9587 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.434145:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083ae52cc/0xa13e120d54ca9580 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.434153:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070cfd63b/0xa13e120d54ca9587 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.434153:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.434156:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.434160:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083ae52cc/0xa13e120d54ca9580 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.434163:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070cfd63b/0xa13e120d54ca9587 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.434171:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070cfd63b/0xa13e120d54ca9587 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.434171:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083ae52cc/0xa13e120d54ca9580 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.434180:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083ae52cc/0xa13e120d54ca9580 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.434191:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083ae52cc/0xa13e120d54ca9580 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.434198:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587946.434205:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788587946.434208:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587946.434212:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.434213:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070cfd63b/0xa13e120d54ca9587 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.434221:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77bc00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.434225:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070cfd63b/0xa13e120d54ca9587 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.434234:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070cfd63b/0xa13e120d54ca9587 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.434686:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070cfd63b/0xa13e120d54ca9587 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.434695:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070cfd63b/0xa13e120d54ca9587 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.434714:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.434715:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.434717:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587946.435391:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.435397:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083ad7a0f/0xa13e120d54ca958e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.435407:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.435410:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.435414:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083ad7a0f/0xa13e120d54ca958e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.435424:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083ad7a0f/0xa13e120d54ca958e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.435431:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083ad7a0f/0xa13e120d54ca958e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.435438:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083ad7a0f/0xa13e120d54ca958e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.435453:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788587946.435800:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.435812:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e69b535/0xa13e120d54ca9595 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.435820:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.435822:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.435826:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e69b535/0xa13e120d54ca9595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.435835:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e69b535/0xa13e120d54ca9595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.435861:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e69b535/0xa13e120d54ca9595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.435868:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e69b535/0xa13e120d54ca9595 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.435876:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788587946.436797:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.436804:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fc06c2a/0xa13e120d54ca959c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.436814:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.436817:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.436822:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fc06c2a/0xa13e120d54ca959c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.436832:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fc06c2a/0xa13e120d54ca959c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.436870:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fc06c2a/0xa13e120d54ca959c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.436877:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fc06c2a/0xa13e120d54ca959c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.436886:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788587946.437413:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.437420:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fdcc35/0xa13e120d54ca95a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.437428:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.437431:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.437436:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071fdcc35/0xa13e120d54ca95a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.437445:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071fdcc35/0xa13e120d54ca95a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.437452:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fdcc35/0xa13e120d54ca95a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.437460:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071fdcc35/0xa13e120d54ca95a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.437481:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788587946.437897:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.437902:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000300177d4/0xa13e120d54ca95aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.437911:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.437913:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.437918:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000300177d4/0xa13e120d54ca95aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.437927:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000300177d4/0xa13e120d54ca95aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.437935:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000300177d4/0xa13e120d54ca95aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.437942:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000300177d4/0xa13e120d54ca95aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.437952:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788587946.439614:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788587946.439626:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083ad7a0f/0xa13e120d54ca958e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439640:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce8c00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.439652:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083ad7a0f/0xa13e120d54ca958e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439664:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083ad7a0f/0xa13e120d54ca958e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439682:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083ad7a0f/0xa13e120d54ca958e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439690:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083ad7a0f/0xa13e120d54ca958e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439713:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788587946.439717:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e69b535/0xa13e120d54ca9595 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439724:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9600 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.439728:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e69b535/0xa13e120d54ca9595 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439735:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e69b535/0xa13e120d54ca9595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439745:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e69b535/0xa13e120d54ca9595 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439752:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e69b535/0xa13e120d54ca9595 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439771:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788587946.439774:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fc06c2a/0xa13e120d54ca959c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439781:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce8a00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.439784:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fc06c2a/0xa13e120d54ca959c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439792:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fc06c2a/0xa13e120d54ca959c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439802:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fc06c2a/0xa13e120d54ca959c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439810:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fc06c2a/0xa13e120d54ca959c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439822:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587946.439826:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071fdcc35/0xa13e120d54ca95a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439832:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9400 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.439835:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fdcc35/0xa13e120d54ca95a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439869:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fdcc35/0xa13e120d54ca95a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439880:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071fdcc35/0xa13e120d54ca95a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439888:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071fdcc35/0xa13e120d54ca95a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439901:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.439906:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000300177d4/0xa13e120d54ca95aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439912:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce8200 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.439916:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000300177d4/0xa13e120d54ca95aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439923:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000300177d4/0xa13e120d54ca95aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439932:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000300177d4/0xa13e120d54ca95aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439939:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000300177d4/0xa13e120d54ca95aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.439963:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.439964:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.439967:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.440151:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.440158:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e8354d9/0xa13e120d54ca95b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.440168:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.440172:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.440177:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e8354d9/0xa13e120d54ca95b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.440187:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e8354d9/0xa13e120d54ca95b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.440195:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e8354d9/0xa13e120d54ca95b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.440202:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e8354d9/0xa13e120d54ca95b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.440223:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.440232:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.440235:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e8354d9/0xa13e120d54ca95b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.440251:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77a000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.440255:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e8354d9/0xa13e120d54ca95b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.440262:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e8354d9/0xa13e120d54ca95b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.440273:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e8354d9/0xa13e120d54ca95b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.440279:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e8354d9/0xa13e120d54ca95b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.440293:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.440295:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.440296:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587946.440879:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.440887:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a14a782/0xa13e120d54ca95b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.440896:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.440904:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.440909:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a14a782/0xa13e120d54ca95b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.440918:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a14a782/0xa13e120d54ca95b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.440927:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a14a782/0xa13e120d54ca95b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.440934:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a14a782/0xa13e120d54ca95b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.440954:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.441378:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.441383:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a14a782/0xa13e120d54ca95b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.441390:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce8400 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.441394:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a14a782/0xa13e120d54ca95b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.441402:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a14a782/0xa13e120d54ca95b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.441421:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a14a782/0xa13e120d54ca95b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.441428:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a14a782/0xa13e120d54ca95b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.441443:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.441445:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.441447:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.441489:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.441762:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083ae52cc/0xa13e120d54ca9580 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.441772:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce8000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.441775:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083ae52cc/0xa13e120d54ca9580 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.441784:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083ae52cc/0xa13e120d54ca9580 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.441795:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083ae52cc/0xa13e120d54ca9580 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.441802:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083ae52cc/0xa13e120d54ca9580 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.441829:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.441832:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.441833:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587946.442914:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.442922:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a1a4ce2/0xa13e120d54ca95bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.442934:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.442938:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.442944:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1a4ce2/0xa13e120d54ca95bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.442955:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1a4ce2/0xa13e120d54ca95bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.442964:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a1a4ce2/0xa13e120d54ca95bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587946.443043:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.443049:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1a2f15/0xa13e120d54ca95c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.443055:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1a4ce2/0xa13e120d54ca95bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443057:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.443060:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.443065:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1a2f15/0xa13e120d54ca95c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443074:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e1a2f15/0xa13e120d54ca95c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443081:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1a2f15/0xa13e120d54ca95c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443087:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e1a2f15/0xa13e120d54ca95c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443102:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.443112:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.443116:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e1a2f15/0xa13e120d54ca95c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.443131:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.443135:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bf77ae00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.443138:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1a2f15/0xa13e120d54ca95c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443147:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1a2f15/0xa13e120d54ca95c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443158:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e1a2f15/0xa13e120d54ca95c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443166:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e1a2f15/0xa13e120d54ca95c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443181:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.443185:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1a4ce2/0xa13e120d54ca95bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443191:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9800 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.443194:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1a4ce2/0xa13e120d54ca95bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443201:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1a4ce2/0xa13e120d54ca95bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443211:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1a4ce2/0xa13e120d54ca95bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443223:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1a4ce2/0xa13e120d54ca95bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443237:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.443238:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.443240:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587946.443518:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.443524:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000211df286/0xa13e120d54ca95cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.443532:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.443535:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.443540:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000211df286/0xa13e120d54ca95cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.443549:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000211df286/0xa13e120d54ca95cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.443557:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000211df286/0xa13e120d54ca95cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.443564:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000211df286/0xa13e120d54ca95cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443570:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.443578:0:15852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.443583:0:15852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000211df286/0xa13e120d54ca95cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.443588:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788587946.443592:0:15852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bee33200 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.443595:0:15852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000211df286/0xa13e120d54ca95cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443603:0:15852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000211df286/0xa13e120d54ca95cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443614:0:15852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000211df286/0xa13e120d54ca95cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443621:0:15852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000211df286/0xa13e120d54ca95cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.443636:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.443640:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.443646:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.443648:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.444065:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.444071:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca95db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.444080:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.444083:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.444087:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca95db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.444097:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca95db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.444104:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca95db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.444111:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca95db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.444125:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.444133:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.444137:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca95db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.444143:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.444146:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca95db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.444163:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca95db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.444174:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca95db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.444181:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000207d8fbc/0xa13e120d54ca95db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.444194:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.444196:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.444197:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587946.444266:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.444272:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006906bc2e/0xa13e120d54ca95d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.444286:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.444289:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.444293:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006906bc2e/0xa13e120d54ca95d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.444303:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006906bc2e/0xa13e120d54ca95d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.444311:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006906bc2e/0xa13e120d54ca95d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.444319:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006906bc2e/0xa13e120d54ca95d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.444336:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788587946.444705:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587946.444710:0:15850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb73fc13/0xa13e120d54ca95e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.444717:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788587946.444720:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587946.444725:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb73fc13/0xa13e120d54ca95e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.444734:0:15850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb73fc13/0xa13e120d54ca95e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.444753:0:15850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb73fc13/0xa13e120d54ca95e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.444760:0:15850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb73fc13/0xa13e120d54ca95e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587946.444775:0:15850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1788587946.445163:0:15850:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1788587946.445261:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14397:x1875470043935360:12345-0@lo:5:osp-pre-0-0.0 Request processed in 56079us (61002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587946.445270:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587946.445326:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14397:1875470043935360:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788587946.445340:0:14397:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788587946.445385:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14397:1875470043935488:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788587946.445420:0:14397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587946.445458:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f487a6b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587946.445476:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043935488 00000100:00100000:0.0:1788587946.445481:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043935488 00000100:00100000:0.0:1788587946.445516:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587946.445525:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14397:x1875470043935488:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788587946.445559:0:15061:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1788587946.446905:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587946.446914:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006906bc2e/0xa13e120d54ca95d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.446926:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bee32800 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:3.0:1788587946.446930:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006906bc2e/0xa13e120d54ca95d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.446941:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006906bc2e/0xa13e120d54ca95d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.446959:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006906bc2e/0xa13e120d54ca95d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.446968:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006906bc2e/0xa13e120d54ca95d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.447139:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587946.447144:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb73fc13/0xa13e120d54ca95e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.447150:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bee32000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:3.0:1788587946.447153:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb73fc13/0xa13e120d54ca95e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.447161:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb73fc13/0xa13e120d54ca95e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.447178:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb73fc13/0xa13e120d54ca95e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.447185:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb73fc13/0xa13e120d54ca95e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.447196:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587946.447198:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587946.447200:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.447440:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.447903:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.447910:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca95e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.447922:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.447925:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.447931:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca95e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.447942:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca95e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.447951:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca95e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.447964:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca95e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.447979:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.447989:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.447993:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca95e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.448011:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159d000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.448014:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca95e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.448022:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca95e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.448033:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca95e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.448041:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004307bf13/0xa13e120d54ca95e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.448055:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.448057:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.448058:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.448654:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.448668:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca95f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.448677:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.448680:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.448685:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca95f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.448694:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca95f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.448702:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca95f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.448709:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca95f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.448732:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587946.448887:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587946.448894:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca95f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.448901:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c600 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:3.0:1788587946.448905:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca95f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.448914:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca95f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.448927:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca95f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.448934:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000593662a1/0xa13e120d54ca95f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.448960:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587946.448961:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587946.448963:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.449133:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.449138:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca95f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.449146:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.449149:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.449152:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca95f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.449161:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca95f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.449174:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca95f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.449181:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca95f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.449193:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.449203:0:15852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.449206:0:15852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca95f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.449212:0:15852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159de00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.449215:0:15852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca95f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.449221:0:15852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca95f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.449231:0:15852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca95f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.449238:0:15852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7027af7/0xa13e120d54ca95f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.449329:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.449336:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.449338:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.450640:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.450649:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca95fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.450661:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.450665:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.450672:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca95fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.450683:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca95fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.450693:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca95fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.450701:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca95fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.450728:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587946.450890:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587946.450896:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca95fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.450904:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159c800 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:3.0:1788587946.450908:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca95fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.450917:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca95fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.450930:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca95fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.450937:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e1c7254/0xa13e120d54ca95fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.450954:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587946.450955:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587946.450957:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.451885:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.451893:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca9605 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.451905:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.451908:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.451914:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca9605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.451929:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca9605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.451939:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca9605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.451946:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca9605 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.451960:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587946.452667:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.452674:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca960c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452683:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.452686:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.452691:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca960c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452700:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca960c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452708:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca960c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452725:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca960c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452742:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788587946.452752:0:15852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587946.452757:0:15852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca9605 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452777:0:15852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159da00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.452781:0:15852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca9605 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452789:0:15852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca9605 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452804:0:15852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca9605 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452811:0:15852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076f7050e/0xa13e120d54ca9605 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452827:0:15852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.452831:0:15852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca960c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452865:0:15852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4c159ca00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.452869:0:15852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca960c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452878:0:15852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca960c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452888:0:15852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca960c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452896:0:15852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eb43e5f/0xa13e120d54ca960c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.452910:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.452912:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.452914:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.453596:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.453603:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9613 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.453612:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.453615:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.453619:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9613 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.453627:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9613 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.453640:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9613 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.453646:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9613 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.453660:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788587946.453688:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14397:x1875470043935488:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8161us (8264us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788587946.453698:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587946.453757:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14397:1875470043935488:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788587946.453774:0:14397:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00002000:00010000:2.0:1788587946.454067:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.454073:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000137aa745/0xa13e120d54ca961a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.454082:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.454085:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.454089:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000137aa745/0xa13e120d54ca961a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.454097:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000137aa745/0xa13e120d54ca961a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.454104:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000137aa745/0xa13e120d54ca961a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.454112:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000137aa745/0xa13e120d54ca961a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.454137:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788587946.454146:0:15852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587946.454151:0:15852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9613 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.454157:0:15852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9e00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.454161:0:15852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9613 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.454169:0:15852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9613 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.454181:0:15852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9613 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.454187:0:15852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9613 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.454200:0:15852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.454203:0:15852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000137aa745/0xa13e120d54ca961a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.454208:0:15852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9a00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.454211:0:15852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000137aa745/0xa13e120d54ca961a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.454227:0:15852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000137aa745/0xa13e120d54ca961a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.454236:0:15852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000137aa745/0xa13e120d54ca961a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.454243:0:15852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000137aa745/0xa13e120d54ca961a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.455187:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.455189:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.455191:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587946.456127:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587946.456134:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.458953:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.458965:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008589d8fc/0xa13e120d54ca9621 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.458982:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.458987:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.458994:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008589d8fc/0xa13e120d54ca9621 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.459018:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008589d8fc/0xa13e120d54ca9621 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.459028:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008589d8fc/0xa13e120d54ca9621 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.459048:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008589d8fc/0xa13e120d54ca9621 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.459069:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587946.459084:0:15852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587946.459089:0:15852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008589d8fc/0xa13e120d54ca9621 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.459096:0:15852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce8600 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587946.459100:0:15852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008589d8fc/0xa13e120d54ca9621 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.459108:0:15852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008589d8fc/0xa13e120d54ca9621 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.459124:0:15852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008589d8fc/0xa13e120d54ca9621 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.459132:0:15852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008589d8fc/0xa13e120d54ca9621 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.459152:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.459154:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587946.459155:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587946.461084:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587946.461100:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a1a4ce2/0xa13e120d54ca9628 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.461116:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788587946.461120:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587946.461126:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a1a4ce2/0xa13e120d54ca9628 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.461138:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a1a4ce2/0xa13e120d54ca9628 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.461147:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a1a4ce2/0xa13e120d54ca9628 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.461155:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a1a4ce2/0xa13e120d54ca9628 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587946.461175:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587946.461307:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587946.461318:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a1a4ce2/0xa13e120d54ca9628 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.461326:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9800 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:3.0:1788587946.461331:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a1a4ce2/0xa13e120d54ca9628 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.461341:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a1a4ce2/0xa13e120d54ca9628 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788587946.461352:0:15059:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00010000:00010000:3.0:1788587946.461355:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a1a4ce2/0xa13e120d54ca9628 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.461361:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a1a4ce2/0xa13e120d54ca9628 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587946.461376:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587946.461378:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587946.461379:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587946.461437:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14399:x1875470043935104:12345-0@lo:5:osp-pre-1-0.0 Request processed in 79623us (79708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587946.461457:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587946.462205:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14399:1875470043935104:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788587946.462219:0:14399:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788587946.462314:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab64e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14399:1875470043935616:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788587946.462351:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587946.462381:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f48537db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587946.462400:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043935616 00000100:00100000:3.0:1788587946.462405:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043935616 00000100:00100000:3.0:1788587946.462458:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587946.462466:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14399:x1875470043935616:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788587946.462501:0:15062:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788587946.478222:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14399:x1875470043935616:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15505us (15617us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788587946.478236:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587946.479123:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab64e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14399:1875470043935616:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788587946.479140:0:14399:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:1.0:1788587946.487563:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788587946.487614:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788587946.697331:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788587947.212056:0:14373:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788587947.212074:0:14373:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88f381d1d800 from 8 10000000:01000000:0.0:1788587947.212079:0:14373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788587947.212125:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bee33600/0xa13e120d54ca962f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587947.212136:0:14373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4bee33600/0xa13e120d54ca962f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587947.212146:0:14373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4bee33600/0xa13e120d54ca962f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587947.212170:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043935744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587947.212232:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587947.212276:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f487a6be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587947.212539:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043935744 00000100:00100000:1.0:1788587947.212547:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043935744 00000100:00100000:1.0:1788587947.212601:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587947.212610:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+18:14373:x1875470043935744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587947.212631:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587947.212646:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4856c0600/0xa13e120d54ca9636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca962f expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587947.212667:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4856c0600/0xa13e120d54ca9636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca962f expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587947.212678:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4856c0600/0xa13e120d54ca9636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca962f expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587947.212687:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0600, rc 0) 00000100:00100000:1.0:1788587947.212733:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+19:14373:x1875470043935744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587947.212739:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788587947.213016:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043935744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587947.213030:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4bee33600/0xa13e120d54ca962f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9636 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587947.213040:0:14373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4bee33600/0xa13e120d54ca962f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca9636 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587947.213089:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043935872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788587947.213122:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587947.213141:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f487a6be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587947.213206:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043935872 00000100:00100000:2.0:1788587947.213211:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043935872 00000100:00100000:2.0:1788587947.213239:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788587947.213252:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+19:14373:x1875470043935872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788587947.213266:0:14367:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788587947.213280:0:14367:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788587947.213284:0:14367:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788587947.213366:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+19:14373:x1875470043935872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587947.213373:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788587947.213736:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043935872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788587947.213794:0:14373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788587947.213801:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bee33600/0xa13e120d54ca962f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9636 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587947.213810:0:14373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4bee33600/0xa13e120d54ca962f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca9636 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587947.722591:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788587948.584882:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788587948.584951:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788587948.744415:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587949.768284:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788587950.624867:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788587950.624897:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1788587950.797988:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587951.560342:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:475e03e7-2028-419a-a63d-caf8ec05d538:3303:1875470043936000:0@lo:400:kworker.0 00000100:00100000:1.0:1788587951.560434:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587951.560493:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043936512:0@lo:400:kworker.0 00000100:00100000:1.0:1788587951.560541:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587951.560571:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587951.560577:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043936384:0@lo:400:kworker.0 00000100:00100000:1.0:1788587951.560601:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587951.560628:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043936128:0@lo:400:kworker.0 00000100:00100000:1.0:1788587951.560679:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587951.560700:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875470043936640:0@lo:400:kworker.0 00000100:00100000:1.0:1788587951.560737:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587951.560767:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587951.560773:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf76ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043936256:0@lo:400:kworker.0 00000100:00100000:1.0:1788587951.560797:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587951.560827:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043936128 00000100:00100000:1.0:1788587951.560836:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043936128 00000100:00100000:1.0:1788587951.560910:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043936256 00000100:00100000:1.0:1788587951.560913:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043936256 00000100:00100000:1.0:1788587951.560937:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587951.560946:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043936128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587951.561012:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043936128:12345-0@lo:400:kworker.0 Request processed in 66us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587951.561020:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587951.561051:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587951.561057:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043936256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587951.561085:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043936256:12345-0@lo:400:kworker.0 Request processed in 28us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587951.561091:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587951.561109:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043936512 00000100:00100000:1.0:1788587951.561113:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043936512 00000100:00100000:1.0:1788587951.561136:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043936384 00000100:00100000:1.0:1788587951.561139:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043936384 00000100:00100000:1.0:1788587951.561149:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043936640 00000100:00100000:1.0:1788587951.561151:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043936640 00000100:00100000:1.0:1788587951.561165:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788587951.561172:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043936512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587951.561210:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043936512:12345-0@lo:400:kworker.0 Request processed in 39us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587951.561216:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788587951.561236:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587951.561242:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043936384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587951.561271:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043936384:12345-0@lo:400:kworker.0 Request processed in 29us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587951.561276:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587951.561295:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587951.561301:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875470043936640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587951.561328:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875470043936640:12345-0@lo:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587951.561335:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788587951.561352:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587951.561357:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587951.561359:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587951.561687:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788587951.561708:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043936256:0@lo:400:kworker.0 00000100:00100000:1.0:1788587951.561720:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788587951.561730:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043936128:0@lo:400:kworker.0 00010000:00080000:1.0:1788587951.561744:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf76d880 x1875470043936640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587951.561754:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875470043936640:0@lo:400:kworker.0 00010000:00080000:1.0:1788587951.561795:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf76f480 x1875470043936384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587951.561805:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043936384:0@lo:400:kworker.0 00010000:00080000:1.0:1788587951.561816:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88f4bf76f100 x1875470043936512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587951.561833:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043936512:0@lo:400:kworker.0 00000100:00100000:0.0:1788587951.563209:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043936000 00000100:00100000:0.0:1788587951.563220:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043936000 00000100:00100000:0.0:1788587951.563274:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788587951.563285:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+19:3303:x1875470043936000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587951.563374:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+19:3303:x1875470043936000:12345-0@lo:400:kworker.0 Request processed in 91us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587951.563382:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788587951.563443:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043936768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587951.563480:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587951.563513:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043936768 00000100:00100000:3.0:1788587951.563520:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043936768 00000100:00100000:3.0:1788587951.563557:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587951.563567:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043936768:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587951.563572:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043936896:0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587951.563605:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587951.563607:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587951.563657:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043936768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587951.563665:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587951.563680:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043936896 00000100:00100000:3.0:1788587951.563684:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043936896 00000100:00100000:0.0:1788587951.563697:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043936768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587951.563703:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587951.563710:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043936896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587951.563732:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587951.563770:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043936896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587951.563776:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587951.563906:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043936896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587951.565031:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf76e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:475e03e7-2028-419a-a63d-caf8ec05d538:3303:1875470043936000:0@lo:400:kworker.0 00000001:02000400:2.0:1788587951.785163:0:16134:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg633-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788587951.816309:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587952.201059:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788587952.842893:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587953.846215:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587953.846299:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026119552 00000100:00100000:2.0:1788587953.846309:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026119552 00000100:00100000:2.0:1788587953.846354:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 75 00000100:00100000:2.0:1788587953.846361:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2343:x1875470026119552:12345-192.168.206.33@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788587953.846387:0:14370:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 652ca569-a046-4217-abb9-8fa30688d32b@192.168.206.33@tcp t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:2.0:1788587953.846415:0:14370:0:(genops.c:1385:class_connect()) connect: client 652ca569-a046-4217-abb9-8fa30688d32b, cookie 0xa13e120d54ca963d 00000100:00080000:2.0:1788587953.846551:0:14370:0:(import.c:65:import_set_state_nolock()) ffff88f3834d6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587953.846624:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+5:2343:x1875470026119552:12345-192.168.206.33@tcp:250:mount.lustre.0 Request processed in 261us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587953.846632:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 75 00000100:00100000:2.0:1788587953.856134:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587953.858270:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026119680 00000100:00100000:0.0:1788587953.858283:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026119680 00000100:00100000:0.0:1788587953.858403:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 76 00000100:00100000:0.0:1788587953.858414:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+5:13714:x1875470026119680:12345-192.168.206.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788587953.858445:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587953.858463:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bee32200/0xa13e120d54ca9644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db14ea expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587953.858494:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bee32200/0xa13e120d54ca9644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14ea expref: 6 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587953.858507:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bee32200/0xa13e120d54ca9644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14ea expref: 6 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587953.858516:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bee32200, rc 0) 00000100:00100000:0.0:1788587953.858592:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+6:13714:x1875470026119680:12345-192.168.206.33@tcp:101:mount.lustre.0 Request processed in 180us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587953.858600:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 76 00010000:00010000:0.0:1788587953.864600:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587953.864868:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587953.865005:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026119808 00000100:00100000:0.0:1788587953.865015:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026119808 00000100:00100000:0.0:1788587953.865120:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 77 00000100:00100000:0.0:1788587953.865131:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+6:13714:x1875470026119808:12345-192.168.206.33@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788587953.865400:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+6:13714:x1875470026119808:12345-192.168.206.33@tcp:501:mount.lustre.0 Request processed in 270us (566us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788587953.865409:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 77 00000100:00100000:1.0:1788587953.869457:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587953.869561:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026119936 00000100:00100000:0.0:1788587953.869571:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026119936 00000100:00100000:0.0:1788587953.869674:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 78 00000100:00100000:0.0:1788587953.869684:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+6:13714:x1875470026119936:12345-192.168.206.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788587953.869700:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587953.869727:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bee33400/0xa13e120d54ca964b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db14f1 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587953.869756:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bee33400/0xa13e120d54ca964b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14f1 expref: 7 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587953.869767:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bee33400/0xa13e120d54ca964b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db14f1 expref: 7 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587953.869776:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bee33400, rc 0) 00000100:00100000:0.0:1788587953.869836:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+7:13714:x1875470026119936:12345-192.168.206.33@tcp:101:mount.lustre.0 Request processed in 153us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587953.869871:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 78 00000100:00100000:1.0:1788587953.871936:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587953.872037:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026120064 00000100:00100000:0.0:1788587953.872045:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026120064 00000100:00100000:0.0:1788587953.872094:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 79 00000100:00100000:0.0:1788587953.872104:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+7:13714:x1875470026120064:12345-192.168.206.33@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788587953.872424:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+8:13714:x1875470026120064:12345-192.168.206.33@tcp:501:mount.lustre.0 Request processed in 320us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587953.872433:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 79 00000100:00100000:3.0:1788587953.877934:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587953.878032:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026120192 00000100:00100000:0.0:1788587953.878041:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026120192 00000100:00100000:0.0:1788587953.878097:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 80 00000100:00100000:0.0:1788587953.878107:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+8:13714:x1875470026120192:12345-192.168.206.33@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788587953.878314:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+8:13714:x1875470026120192:12345-192.168.206.33@tcp:503:mount.lustre.0 Request processed in 207us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587953.878321:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 80 00000100:00100000:1.0:1788587953.886520:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587953.889549:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026120320 00000100:00100000:2.0:1788587953.889562:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026120320 00000100:00100000:3.0:1788587953.890154:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 81 00000100:00100000:3.0:1788587953.890174:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+8:13732:x1875470026120320:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788587953.890437:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+8:13732:x1875470026120320:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 274us (3925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587953.890445:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 81 00000100:00100000:1.0:1788587953.899749:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587953.900034:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026120448 00000100:00100000:2.0:1788587953.900044:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026120448 00000100:00100000:2.0:1788587953.900138:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 82 00000100:00100000:2.0:1788587953.900161:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+8:13732:x1875470026120448:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587953.900674:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+8:13732:x1875470026120448:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 514us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587953.900683:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 82 00000100:00100000:1.0:1788587953.904543:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587953.905637:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026120576 00000100:00100000:3.0:1788587953.905648:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026120576 00000100:00100000:3.0:1788587953.905703:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 83 00000100:00100000:3.0:1788587953.905712:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+8:13714:x1875470026120576:12345-192.168.206.33@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788587953.905729:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587953.905745:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f480031c00/0xa13e120d54ca9652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db151b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587953.905781:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f480031c00/0xa13e120d54ca9652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db151b expref: 9 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587953.905793:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f480031c00/0xa13e120d54ca9652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db151b expref: 9 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587953.905802:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031c00, rc 0) 00000100:00100000:3.0:1788587953.905876:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+9:13714:x1875470026120576:12345-192.168.206.33@tcp:101:mount.lustre.0 Request processed in 164us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587953.905883:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 83 00000100:00100000:1.0:1788587953.910557:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587953.910694:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026120704 00000100:00100000:2.0:1788587953.910709:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026120704 00000100:00100000:2.0:1788587953.910781:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 84 00000100:00100000:2.0:1788587953.910798:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+9:13714:x1875470026120704:12345-192.168.206.33@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788587953.910824:0:14369:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788587953.910882:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788587953.910887:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788587953.910890:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788587953.910893:0:14369:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788587953.913520:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+9:13714:x1875470026120704:12345-192.168.206.33@tcp:256:mount.lustre.0 Request processed in 2719us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587953.913532:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 84 00000100:00100000:1.0:1788587953.916176:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587953.916305:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026120832 00000100:00100000:0.0:1788587953.916314:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026120832 00000100:00100000:0.0:1788587953.916416:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 85 00000100:00100000:0.0:1788587953.916426:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+9:13714:x1875470026120832:12345-192.168.206.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788587953.916442:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587953.916459:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bee32a00/0xa13e120d54ca9659 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1522 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587953.916493:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bee32a00/0xa13e120d54ca9659 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1522 expref: 10 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587953.916504:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bee32a00/0xa13e120d54ca9659 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1522 expref: 10 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587953.916512:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bee32a00, rc 0) 00000100:00100000:0.0:1788587953.916563:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+10:13714:x1875470026120832:12345-192.168.206.33@tcp:101:mount.lustre.0 Request processed in 139us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587953.916570:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 85 00000100:00100000:1.0:1788587953.918955:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587953.919075:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026120960 00000100:00100000:2.0:1788587953.919082:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026120960 00000100:00100000:2.0:1788587953.919157:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 86 00000100:00100000:2.0:1788587953.919165:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+10:13714:x1875470026120960:12345-192.168.206.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788587953.919420:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+10:13714:x1875470026120960:12345-192.168.206.33@tcp:501:mount.lustre.0 Request processed in 255us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587953.919428:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 86 00000100:00100000:1.0:1788587953.921774:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587953.921921:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026121088 00000100:00100000:0.0:1788587953.921929:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026121088 00000100:00100000:0.0:1788587953.922038:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 87 00000100:00100000:0.0:1788587953.922048:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+10:13714:x1875470026121088:12345-192.168.206.33@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788587953.922250:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+10:13714:x1875470026121088:12345-192.168.206.33@tcp:503:mount.lustre.0 Request processed in 203us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587953.922258:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 87 00000100:00100000:1.0:1788587953.925669:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587953.926049:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026121216 00000100:00100000:2.0:1788587953.926057:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026121216 00000100:00100000:2.0:1788587953.926106:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 88 00000100:00100000:2.0:1788587953.926125:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+10:13734:x1875470026121216:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587953.926343:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+10:13734:x1875470026121216:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 219us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587953.926352:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 88 00000100:00100000:1.0:1788587953.931252:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587953.931569:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026121344 00000100:00100000:0.0:1788587953.931578:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026121344 00000100:00100000:0.0:1788587953.931634:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 89 00000100:00100000:0.0:1788587953.931656:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+10:13734:x1875470026121344:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587953.931920:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+10:13734:x1875470026121344:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 264us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587953.931928:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 89 00000100:00100000:1.0:1788587953.947414:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587953.947502:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026121472 00000100:00100000:2.0:1788587953.947513:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026121472 00000100:00100000:2.0:1788587953.947606:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 4 00000100:00100000:2.0:1788587953.947614:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2343:x1875470026121472:12345-192.168.206.33@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788587953.947640:0:14376:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7adcb4d2-d264-45f5-9771-e68a1801e7d6@192.168.206.33@tcp t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:2.0:1788587953.947684:0:14376:0:(genops.c:1385:class_connect()) connect: client 7adcb4d2-d264-45f5-9771-e68a1801e7d6, cookie 0xa13e120d54ca9660 00000004:00100000:2.0:1788587953.947713:0:14376:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788587953.947718:0:14376:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788587953.991314:0:14376:0:(import.c:65:import_set_state_nolock()) ffff88f4bbeb6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587953.991391:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:2343:x1875470026121472:12345-192.168.206.33@tcp:38:mount.lustre.0 Request processed in 43775us (43985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587953.991418:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 4 00000100:00100000:1.0:1788587953.995954:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587953.996012:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587953.996135:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026121728 00000100:00100000:0.0:1788587953.996146:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026121728 00000100:00100000:0.0:1788587953.996223:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026121600 00000100:00100000:0.0:1788587953.996227:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026121600 00000100:00100000:0.0:1788587953.996244:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:0.0:1788587953.996253:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+7:13714:x1875470026121728:12345-192.168.206.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788587953.996293:0:14374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1788587953.996337:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587953.996384:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+7:13714:x1875470026121728:12345-192.168.206.33@tcp:41:mount.lustre.0 Request processed in 131us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587953.996391:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:0.0:1788587953.996408:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:0.0:1788587953.996414:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:0:x1875470026121600:12345-192.168.206.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788587953.996426:0:14374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587953.996449:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:0:x1875470026121600:12345-192.168.206.33@tcp:41:mount.lustre.0 Request processed in 35us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587953.996455:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:1.0:1788587954.000223:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587954.000332:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026121856 00000100:00100000:2.0:1788587954.000342:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026121856 00000100:00100000:2.0:1788587954.000400:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:2.0:1788587954.000410:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:13714:x1875470026121856:12345-192.168.206.33@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788587954.000531:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:13714:x1875470026121856:12345-192.168.206.33@tcp:40:mount.lustre.0 Request processed in 122us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587954.000550:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:1.0:1788587954.011429:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587954.011468:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587954.011497:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587954.011556:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026122240 00000100:00100000:3.0:1788587954.011566:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026122240 00000100:00100000:3.0:1788587954.011615:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00100000:3.0:1788587954.011627:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:13714:x1875470026122240:12345-192.168.206.33@tcp:33:mount.lustre.0 00000100:00100000:2.0:1788587954.013477:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026121984 00000100:00100000:2.0:1788587954.013488:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026121984 00000100:00100000:2.0:1788587954.013520:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026122112 00000100:00100000:2.0:1788587954.013524:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026122112 00000100:00100000:2.0:1788587954.013544:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:2.0:1788587954.013551:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2343:x1875470026121984:12345-192.168.206.33@tcp:8:mount.lustre.0 00000100:00100000:3.0:1788587954.013658:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:3.0:1788587954.013665:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1875470026122112:12345-192.168.206.33@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788587954.013690:0:15059:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7adcb4d2-d264-45f5-9771-e68a1801e7d6@192.168.206.33@tcp t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:3.0:1788587954.013720:0:15059:0:(genops.c:1385:class_connect()) connect: client 7adcb4d2-d264-45f5-9771-e68a1801e7d6, cookie 0xa13e120d54ca9667 00002000:00100000:3.0:1788587954.013731:0:15059:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7adcb4d2-d264-45f5-9771-e68a1801e7d6/ffff88f4bbeb5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788587954.013814:0:15059:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00010000:00080000:2.0:1788587954.014274:0:15062:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7adcb4d2-d264-45f5-9771-e68a1801e7d6@192.168.206.33@tcp t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:2.0:1788587954.014298:0:15062:0:(genops.c:1385:class_connect()) connect: client 7adcb4d2-d264-45f5-9771-e68a1801e7d6, cookie 0xa13e120d54ca966e 00002000:00100000:2.0:1788587954.014305:0:15062:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7adcb4d2-d264-45f5-9771-e68a1801e7d6/ffff88f3834d5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788587954.014319:0:15062:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788587954.014639:0:15059:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788587954.014675:0:15059:0:(import.c:65:import_set_state_nolock()) ffff88f4bbeb3000 : changing import state from RECOVER to FULL 00002000:00080000:2.0:1788587954.015050:0:15062:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788587954.015067:0:15062:0:(import.c:65:import_set_state_nolock()) ffff88f3834d1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587954.015094:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:2343:x1875470026121984:12345-192.168.206.33@tcp:8:mount.lustre.0 Request processed in 1542us (3674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587954.015104:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:3.0:1788587954.015546:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:2343:x1875470026122112:12345-192.168.206.33@tcp:8:mount.lustre.0 Request processed in 1080us (3247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587954.015555:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 7 00000004:00080000:3.0:1788587954.015739:0:14377:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4050us 00000004:00200000:3.0:1788587954.033287:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788587954.033411:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:13714:x1875470026122240:12345-192.168.206.33@tcp:33:mount.lustre.0 Request processed in 21782us (21936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587954.033423:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00100000:1.0:1788587954.231286:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587954.231640:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026122368 00000100:00100000:0.0:1788587954.231650:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026122368 00000100:00100000:0.0:1788587954.231747:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 8 00000100:00100000:0.0:1788587954.231759:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:13755:x1875470026122368:12345-192.168.206.33@tcp:101:mkdir.0 00010000:00010000:0.0:1788587954.231778:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587954.231888:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32c00/0xa13e120d54ca9675 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db154c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587954.231969:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32000/0xa13e120d54ca967c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587954.231982:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32000/0xa13e120d54ca967c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587954.231998:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32000/0xa13e120d54ca967c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587954.232031:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587954.232035:0:14374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587954.232069:0:14374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32000/0xa13e120d54ca967c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587954.232093:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32c00/0xa13e120d54ca9675 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db154c expref: 8 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587954.232108:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32000/0xa13e120d54ca967c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db154c expref: 7 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587954.232116:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f49f9bac00) 00010000:00010000:0.0:1788587954.232119:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587954.232122:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bee32000, rc 0) 00000100:00100000:0.0:1788587954.232225:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+7:13755:x1875470026122368:12345-192.168.206.33@tcp:101:mkdir.0 Request processed in 468us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587954.232232:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 8 00010000:00010000:1.0:1788587954.889926:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788587955.716819:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7adcb4d2-d264-45f5-9771-e68a1801e7d6 00010000:00010000:3.0:1788587955.912350:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587956.406548:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587956.407896:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026122496 00000100:00100000:2.0:1788587956.407909:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026122496 00000100:00100000:2.0:1788587956.408025:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00100000:2.0:1788587956.408039:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+7:13807:x1875470026122496:12345-192.168.206.33@tcp:41:lfs.0 00000004:00000024:2.0:1788587956.408082:0:14375:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1788587956.408289:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587956.408876:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+7:13807:x1875470026122496:12345-192.168.206.33@tcp:41:lfs.0 Request processed in 804us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587956.408887:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00100000:1.0:1788587956.423048:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587956.423135:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026122624 00000100:00100000:3.0:1788587956.423145:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026122624 00000100:00100000:3.0:1788587956.423225:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 4 00000100:00100000:3.0:1788587956.423236:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:13807:x1875470026122624:12345-192.168.206.33@tcp:13:lfs.0 00002000:00000024:3.0:1788587956.423275:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587956.423355:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:13807:x1875470026122624:12345-192.168.206.33@tcp:13:lfs.0 Request processed in 121us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587956.423363:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 4 00000100:00080000:1.0:1788587956.423866:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587956.429057:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587956.429314:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026122752 00000100:00100000:3.0:1788587956.429323:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026122752 00000100:00100000:3.0:1788587956.429418:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:3.0:1788587956.429427:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7adcb4d2-d264-45f5-9771-e68a1801e7d6+5:13807:x1875470026122752:12345-192.168.206.33@tcp:13:lfs.0 00002000:00000024:3.0:1788587956.429461:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587956.429544:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7adcb4d2-d264-45f5-9771-e68a1801e7d6+5:13807:x1875470026122752:12345-192.168.206.33@tcp:13:lfs.0 Request processed in 117us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587956.429552:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00080000:1.0:1788587956.430387:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587956.657025:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587956.658372:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026122880 00000100:00100000:1.0:1788587956.658384:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026122880 00000100:00100000:1.0:1788587956.658452:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 90 00000100:00100000:1.0:1788587956.658463:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b53a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+10:13838:x1875470026122880:12345-192.168.206.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788587956.658478:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587956.658493:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4856c0400/0xa13e120d54ca9683 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1553 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587956.658533:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4856c0400/0xa13e120d54ca9683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1553 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587956.658546:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4856c0400/0xa13e120d54ca9683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1553 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587956.658556:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0400, rc 0) 00000100:00100000:1.0:1788587956.658636:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b53a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+11:13838:x1875470026122880:12345-192.168.206.33@tcp:101:mount.lustre.0 Request processed in 175us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587956.659107:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 90 00000100:00100000:2.0:1788587956.664638:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587956.665190:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026123008 00000100:00100000:0.0:1788587956.665201:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026123008 00000100:00100000:0.0:1788587956.665306:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 91 00000100:00100000:0.0:1788587956.665317:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+11:13838:x1875470026123008:12345-192.168.206.33@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788587956.667193:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+11:13838:x1875470026123008:12345-192.168.206.33@tcp:501:mount.lustre.0 Request processed in 1869us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587956.667205:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 91 00000100:00100000:2.0:1788587956.676233:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587956.677081:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026123136 00000100:00100000:1.0:1788587956.677092:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026123136 00000100:00100000:1.0:1788587956.677975:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 92 00000100:00100000:1.0:1788587956.677990:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+11:13838:x1875470026123136:12345-192.168.206.33@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788587956.678311:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+11:13838:x1875470026123136:12345-192.168.206.33@tcp:503:mount.lustre.0 Request processed in 325us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587956.678326:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 92 00000100:00100000:0.0:1788587956.683361:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587956.683383:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043937024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587956.683455:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587956.683708:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043937024 00000100:00100000:3.0:1788587956.683715:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043937024 00000100:00100000:3.0:1788587956.683761:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587956.683768:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043937024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587956.683788:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587956.683825:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043937024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587956.683832:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587956.683958:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043937152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587956.683985:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587956.684030:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043937152 00000100:00100000:0.0:1788587956.684034:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043937152 00000100:00100000:0.0:1788587956.684057:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587956.684062:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043937152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587956.684073:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587956.684103:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043937152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587956.684109:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587956.684145:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043937152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587956.684172:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043937024:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788587956.684195:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587956.684198:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587956.685885:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043937536:0@lo:400:kworker.0 00000100:00100000:3.0:1788587956.685962:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587956.685993:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587956.685999:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043937408:0@lo:400:kworker.0 00000100:00100000:3.0:1788587956.686022:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587956.686027:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875470043937664:0@lo:400:kworker.0 00000100:00100000:3.0:1788587956.686051:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043937536 00000100:00100000:1.0:1788587956.686053:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587956.686056:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043937536 00000100:00100000:1.0:1788587956.686069:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587956.686074:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bab66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:475e03e7-2028-419a-a63d-caf8ec05d538:3304:1875470043937280:0@lo:400:kworker.0 00000100:00100000:3.0:1788587956.686091:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043937408 00000100:00100000:3.0:1788587956.686094:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043937408 00000100:00100000:1.0:1788587956.686097:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587956.686104:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043937664 00000100:00100000:3.0:1788587956.686107:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043937664 00000100:00100000:3.0:1788587956.686120:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587956.686127:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043937536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587956.686178:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043937536:12345-0@lo:400:kworker.0 Request processed in 51us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587956.686185:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587956.686200:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587956.686206:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043937408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587956.686231:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875470043937408:12345-0@lo:400:kworker.0 Request processed in 26us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587956.686237:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587956.686247:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788587956.686253:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875470043937664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587956.686282:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875470043937664:12345-0@lo:400:kworker.0 Request processed in 29us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587956.686288:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788587956.686320:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875470043937664:0@lo:400:kworker.0 00000100:00100000:1.0:1788587956.686394:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875470043937408:0@lo:400:kworker.0 00000100:00100000:1.0:1788587956.686404:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043937536:0@lo:400:kworker.0 00000100:00080000:0.0:1788587956.686704:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587956.686717:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043937280 00000100:00100000:0.0:1788587956.686727:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043937280 00000100:00100000:0.0:1788587956.686765:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788587956.686773:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+19:3304:x1875470043937280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587956.686815:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+19:3304:x1875470043937280:12345-0@lo:400:kworker.0 Request processed in 43us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587956.686821:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788587956.686925:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bab66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:475e03e7-2028-419a-a63d-caf8ec05d538:3304:1875470043937280:0@lo:400:kworker.0 00000100:00100000:3.0:1788587956.692499:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587956.697034:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026123264 00000100:00100000:1.0:1788587956.697049:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026123264 00000100:00100000:0.0:1788587956.701767:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 94 00000100:00100000:0.0:1788587956.701781:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+11:13846:x1875470026123264:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587956.702173:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+11:13846:x1875470026123264:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 385us (9681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587956.702182:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 94 00000100:00100000:3.0:1788587956.718773:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587956.718980:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026123392 00000100:00100000:2.0:1788587956.718991:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026123392 00000100:00100000:2.0:1788587956.719124:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 95 00000100:00100000:2.0:1788587956.719135:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+11:13846:x1875470026123392:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587956.720416:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+11:13846:x1875470026123392:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 1276us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587956.720429:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 95 00000100:00100000:2.0:1788587956.734937:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587956.735168:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026123520 00000100:00100000:0.0:1788587956.735182:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026123520 00000100:00100000:0.0:1788587956.735255:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 96 00000100:00100000:0.0:1788587956.735267:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+11:13838:x1875470026123520:12345-192.168.206.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788587956.735290:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587956.735313:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bee32800/0xa13e120d54ca968a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db157d expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587956.735350:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bee32800/0xa13e120d54ca968a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db157d expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587956.735365:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bee32800/0xa13e120d54ca968a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db157d expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587956.735390:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bee32800, rc 0) 00000100:00100000:0.0:1788587956.735476:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+12:13838:x1875470026123520:12345-192.168.206.33@tcp:101:mount.lustre.0 Request processed in 211us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587956.735502:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 96 00000100:00100000:3.0:1788587956.746043:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587956.746171:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026123648 00000100:00100000:2.0:1788587956.746184:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026123648 00000100:00100000:2.0:1788587956.746253:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 97 00000100:00100000:2.0:1788587956.746266:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+12:13838:x1875470026123648:12345-192.168.206.33@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788587956.746300:0:14367:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788587956.746330:0:14367:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788587956.746335:0:14367:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788587956.746338:0:14367:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788587956.746341:0:14367:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788587956.749323:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+12:13838:x1875470026123648:12345-192.168.206.33@tcp:256:mount.lustre.0 Request processed in 3043us (3280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587956.749340:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 97 00000100:00100000:3.0:1788587956.752349:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587956.752715:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026123776 00000100:00100000:2.0:1788587956.752728:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026123776 00000100:00100000:2.0:1788587956.752796:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 98 00000100:00100000:2.0:1788587956.752808:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+12:13838:x1875470026123776:12345-192.168.206.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587956.752829:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587956.752876:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f485ce9000/0xa13e120d54ca9691 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1584 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587956.752914:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f485ce9000/0xa13e120d54ca9691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1584 expref: 13 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587956.752928:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f485ce9000/0xa13e120d54ca9691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1584 expref: 13 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587956.752942:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f485ce9000, rc 0) 00000100:00100000:1.0:1788587956.753206:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+13:13838:x1875470026123776:12345-192.168.206.33@tcp:101:mount.lustre.0 Request processed in 397us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587956.753215:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 98 00000100:00100000:3.0:1788587956.755462:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587956.755608:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026123904 00000100:00100000:2.0:1788587956.755620:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026123904 00000100:00100000:2.0:1788587956.755688:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 99 00000100:00100000:2.0:1788587956.755700:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+13:13838:x1875470026123904:12345-192.168.206.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788587956.756116:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+13:13838:x1875470026123904:12345-192.168.206.33@tcp:501:mount.lustre.0 Request processed in 417us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587956.756125:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 99 00000100:00100000:3.0:1788587956.758619:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587956.758741:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026124032 00000100:00100000:0.0:1788587956.758753:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026124032 00000100:00100000:0.0:1788587956.758817:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 100 00000100:00100000:0.0:1788587956.758830:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+13:13838:x1875470026124032:12345-192.168.206.33@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788587956.759362:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+13:13838:x1875470026124032:12345-192.168.206.33@tcp:503:mount.lustre.0 Request processed in 531us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587956.759546:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 100 00000100:00100000:3.0:1788587956.763612:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587956.764005:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026124160 00000100:00100000:1.0:1788587956.764018:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026124160 00000100:00100000:1.0:1788587956.764134:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 101 00000100:00100000:1.0:1788587956.764147:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+13:13851:x1875470026124160:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587956.765953:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+13:13851:x1875470026124160:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 1787us (2333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587956.765969:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 101 00000100:00100000:2.0:1788587956.770295:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587956.776046:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026124288 00000100:00100000:0.0:1788587956.776067:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026124288 00000100:00100000:0.0:1788587956.776140:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 102 00000100:00100000:0.0:1788587956.776152:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+13:13851:x1875470026124288:12345-192.168.206.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587956.781374:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+13:13851:x1875470026124288:12345-192.168.206.33@tcp:502:llog_process_th.0 Request processed in 4591us (10459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587956.781398:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 102 00000100:00100000:3.0:1788587956.792020:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587956.792694:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026124416 00000100:00100000:0.0:1788587956.792709:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026124416 00000100:00100000:0.0:1788587956.792769:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:0.0:1788587956.792779:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2343:x1875470026124416:12345-192.168.206.33@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788587956.792818:0:14376:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c4eadb7a-746b-48ee-a564-eea8a3502288@192.168.206.33@tcp t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:0.0:1788587956.792898:0:14376:0:(genops.c:1385:class_connect()) connect: client c4eadb7a-746b-48ee-a564-eea8a3502288, cookie 0xa13e120d54ca9698 00000004:00100000:0.0:1788587956.792939:0:14376:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788587956.793099:0:14376:0:(import.c:65:import_set_state_nolock()) ffff88f4b51f5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587956.793179:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+6:2343:x1875470026124416:12345-192.168.206.33@tcp:38:mount.lustre.0 Request processed in 400us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587956.793205:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:2.0:1788587956.816003:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587956.816042:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587956.818686:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026124672 00000100:00100000:3.0:1788587956.818708:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026124672 00000100:00100000:3.0:1788587956.818808:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026124544 00000100:00100000:3.0:1788587956.818813:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026124544 00000100:00100000:3.0:1788587956.818837:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:3.0:1788587956.818865:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+7:13838:x1875470026124672:12345-192.168.206.33@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788587956.818926:0:14376:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587956.819038:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+7:13838:x1875470026124672:12345-192.168.206.33@tcp:41:mount.lustre.0 Request processed in 175us (3050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587956.819047:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:3.0:1788587956.819069:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 12 00000100:00100000:3.0:1788587956.819077:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+6:0:x1875470026124544:12345-192.168.206.33@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788587956.819090:0:14376:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587956.819114:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+6:0:x1875470026124544:12345-192.168.206.33@tcp:41:mount.lustre.0 Request processed in 38us (3071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587956.819121:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 12 00000100:00080000:1.0:1788587956.819828:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587956.821882:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587956.822176:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026124800 00000100:00100000:3.0:1788587956.822190:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026124800 00000100:00100000:3.0:1788587956.822350:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 13 00000100:00100000:3.0:1788587956.822363:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+6:13838:x1875470026124800:12345-192.168.206.33@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788587956.822648:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+6:13838:x1875470026124800:12345-192.168.206.33@tcp:40:mount.lustre.0 Request processed in 286us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587956.822657:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 13 00000100:00100000:3.0:1788587956.830068:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587956.830117:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587956.830178:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587956.830507:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026125184 00000100:00100000:0.0:1788587956.830521:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026125184 00000100:00100000:0.0:1788587956.830588:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 1 00000100:00100000:0.0:1788587956.830602:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4eadb7a-746b-48ee-a564-eea8a3502288+6:13838:x1875470026125184:12345-192.168.206.33@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788587956.830700:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788587956.830805:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4eadb7a-746b-48ee-a564-eea8a3502288+6:13838:x1875470026125184:12345-192.168.206.33@tcp:33:mount.lustre.0 Request processed in 205us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587956.830813:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 1 00000100:00100000:1.0:1788587956.831016:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026124928 00000100:00100000:1.0:1788587956.831021:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026124928 00000100:00100000:1.0:1788587956.831056:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026125056 00000100:00100000:1.0:1788587956.831072:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026125056 00000100:00100000:1.0:1788587956.831096:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 8 00000100:00100000:1.0:1788587956.831102:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1875470026124928:12345-192.168.206.33@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788587956.831130:0:15059:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c4eadb7a-746b-48ee-a564-eea8a3502288@192.168.206.33@tcp t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:1.0:1788587956.831166:0:15059:0:(genops.c:1385:class_connect()) connect: client c4eadb7a-746b-48ee-a564-eea8a3502288, cookie 0xa13e120d54ca969f 00002000:00100000:1.0:1788587956.831180:0:15059:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c4eadb7a-746b-48ee-a564-eea8a3502288/ffff88f48ebb0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788587956.831192:0:15059:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788587956.831365:0:15059:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788587956.831403:0:15059:0:(import.c:65:import_set_state_nolock()) ffff88f48ebb4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587956.831622:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4eadb7a-746b-48ee-a564-eea8a3502288+6:2343:x1875470026124928:12345-192.168.206.33@tcp:8:mount.lustre.0 Request processed in 517us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587956.831630:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 8 00000100:00100000:1.0:1788587956.831649:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00100000:1.0:1788587956.831654:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1875470026125056:12345-192.168.206.33@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788587956.831673:0:15059:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c4eadb7a-746b-48ee-a564-eea8a3502288@192.168.206.33@tcp t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:1.0:1788587956.831692:0:15059:0:(genops.c:1385:class_connect()) connect: client c4eadb7a-746b-48ee-a564-eea8a3502288, cookie 0xa13e120d54ca96a6 00002000:00100000:1.0:1788587956.831699:0:15059:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c4eadb7a-746b-48ee-a564-eea8a3502288/ffff88f48ebb6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788587956.831707:0:15059:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788587956.832001:0:15059:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788587956.832018:0:15059:0:(import.c:65:import_set_state_nolock()) ffff88f48ebb2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587956.832043:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4eadb7a-746b-48ee-a564-eea8a3502288+6:2343:x1875470026125056:12345-192.168.206.33@tcp:8:mount.lustre.0 Request processed in 388us (1865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587956.832049:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 9 00010000:00010000:0.0:1788587956.936240:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587956.995206:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587956.998031:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026125312 00000100:00100000:0.0:1788587956.998052:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026125312 00000100:00100000:0.0:1788587956.998217:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 14 00000100:00100000:0.0:1788587956.998231:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4eadb7a-746b-48ee-a564-eea8a3502288+6:13872:x1875470026125312:12345-192.168.206.33@tcp:101:mkdir.0 00010000:00010000:0.0:1788587956.998260:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587956.998289:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33200/0xa13e120d54ca96ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db15ae expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587956.998380:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32c00/0xa13e120d54ca96b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587956.998398:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32c00/0xa13e120d54ca96b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587956.998412:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32c00/0xa13e120d54ca96b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587956.998458:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587956.998478:0:14374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587956.998504:0:14374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32c00/0xa13e120d54ca96b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587956.998535:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33200/0xa13e120d54ca96ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15ae expref: 8 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587956.998558:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32c00/0xa13e120d54ca96b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15ae expref: 7 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587956.998567:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f49f9bac00) 00010000:00010000:0.0:1788587956.998570:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587956.998574:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bee32c00, rc 0) 00000100:00100000:0.0:1788587956.998661:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4eadb7a-746b-48ee-a564-eea8a3502288+7:13872:x1875470026125312:12345-192.168.206.33@tcp:101:mkdir.0 Request processed in 433us (3467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587956.998669:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 14 00010000:00010000:3.0:1788587957.962121:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788587958.793812:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c4eadb7a-746b-48ee-a564-eea8a3502288 00000001:00100000:2.0:1788587958.793826:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7adcb4d2-d264-45f5-9771-e68a1801e7d6 00010000:00010000:3.0:1788587958.984096:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587959.316103:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c4eadb7a-746b-48ee-a564-eea8a3502288 00000001:00100000:1.0:1788587959.316129:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7adcb4d2-d264-45f5-9771-e68a1801e7d6 00010000:00010000:0.0:1788587960.010449:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587960.021797:0:16340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788587960.891356:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c4eadb7a-746b-48ee-a564-eea8a3502288 00010000:00010000:3.0:1788587961.032942:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587961.802380:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043937792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587961.802455:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587961.802527:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043937792 00000100:00100000:1.0:1788587961.802535:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043937792 00000100:00100000:1.0:1788587961.802589:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788587961.802598:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043937792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587961.802630:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587961.802675:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043937792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587961.802681:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788587961.802701:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587961.802747:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043937792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587961.804983:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043937920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587961.805047:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587961.805321:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043937920 00000100:00100000:2.0:1788587961.805330:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043937920 00000100:00100000:2.0:1788587961.805387:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587961.805398:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043937920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587961.805444:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587961.805494:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875470043937920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587961.805501:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788587961.805621:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587961.805657:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875470043937920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587961.808313:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043938176:0@lo:400:kworker.0 00000100:00100000:2.0:1788587961.808374:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587961.808410:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587961.808430:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043938304:0@lo:400:kworker.0 00000100:00100000:2.0:1788587961.808454:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587961.808498:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043938176 00000100:00100000:2.0:1788587961.808505:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043938176 00000100:00100000:2.0:1788587961.808548:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043938304 00000100:00100000:2.0:1788587961.808551:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043938304 00000100:00100000:2.0:1788587961.808574:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788587961.808583:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043938176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587961.808629:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875470043938176:12345-0@lo:400:kworker.0 Request processed in 47us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587961.808637:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788587961.808652:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587961.808658:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043938304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587961.808684:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875470043938304:12345-0@lo:400:kworker.0 Request processed in 27us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587961.808690:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587961.808721:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875470043938304:0@lo:400:kworker.0 00000100:00100000:2.0:1788587961.808733:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875470043938176:0@lo:400:kworker.0 00000100:00080000:1.0:1788587961.808952:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587961.808967:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043938432:0@lo:400:kworker.0 00000100:00100000:1.0:1788587961.808997:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587961.809019:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587961.809025:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f382306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:475e03e7-2028-419a-a63d-caf8ec05d538:3302:1875470043938048:0@lo:400:kworker.0 00000100:00100000:1.0:1788587961.809050:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587961.809169:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043938432 00000100:00100000:3.0:1788587961.809174:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043938432 00000100:00100000:3.0:1788587961.809201:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788587961.809209:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043938432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587961.809255:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043938432:12345-0@lo:400:kworker.0 Request processed in 47us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587961.809261:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788587961.809369:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587961.809394:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043938432:0@lo:400:kworker.0 00000100:00100000:0.0:1788587961.809583:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043938048 00000100:00100000:0.0:1788587961.809588:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043938048 00000100:00100000:0.0:1788587961.809624:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788587961.809631:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+19:3302:x1875470043938048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587961.809679:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+19:3302:x1875470043938048:12345-0@lo:400:kworker.0 Request processed in 48us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587961.809686:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788587961.813718:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f382306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:475e03e7-2028-419a-a63d-caf8ec05d538:3302:1875470043938048:0@lo:400:kworker.0 00010000:00010000:3.0:1788587962.060526:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587962.339161:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587962.339198:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587962.339232:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587962.339255:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587962.339294:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587962.339321:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587962.339366:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587962.339399:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026125440 00000100:00100000:3.0:1788587962.339407:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026125440 00000100:00100000:3.0:1788587962.339457:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 104 00000100:00100000:3.0:1788587962.339468:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+13:2345:x1875470026125440:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587962.339545:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+13:2345:x1875470026125440:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 78us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587962.339554:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 104 00000100:00100000:3.0:1788587962.339591:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026125696 00000100:00100000:3.0:1788587962.339594:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026125696 00000100:00100000:3.0:1788587962.339631:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026126208 00000100:00100000:3.0:1788587962.339635:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026126208 00000100:00100000:3.0:1788587962.339653:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026125824 00000100:00100000:3.0:1788587962.339656:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026125824 00000100:00100000:3.0:1788587962.339674:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026126080 00000100:00100000:3.0:1788587962.339677:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026126080 00000100:00100000:3.0:1788587962.339702:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 2 00000100:00100000:3.0:1788587962.339709:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bab64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+5:2345:x1875470026125696:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587962.339742:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bab64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+5:2345:x1875470026125696:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 33us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587962.339749:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 2 00000100:00100000:3.0:1788587962.339778:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 3 00000100:00100000:3.0:1788587962.339787:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4eadb7a-746b-48ee-a564-eea8a3502288+5:2345:x1875470026126208:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587962.339819:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4eadb7a-746b-48ee-a564-eea8a3502288+5:2345:x1875470026126208:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 33us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587962.339838:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 3 00000100:00100000:3.0:1788587962.339908:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 4 00000100:00100000:3.0:1788587962.339929:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+5:2345:x1875470026125824:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587962.339965:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+5:2345:x1875470026125824:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 50us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587962.339974:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 4 00000100:00100000:3.0:1788587962.339988:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:3.0:1788587962.339996:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4eadb7a-746b-48ee-a564-eea8a3502288+5:2345:x1875470026126080:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587962.340026:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4eadb7a-746b-48ee-a564-eea8a3502288+5:2345:x1875470026126080:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 31us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587962.340032:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:3.0:1788587962.340053:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026125952 00000100:00100000:3.0:1788587962.340056:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026125952 00000100:00100000:3.0:1788587962.340094:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026125568 00000100:00100000:3.0:1788587962.340098:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026125568 00000100:00100000:3.0:1788587962.340126:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 20 00000100:00100000:3.0:1788587962.340134:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+6:2345:x1875470026125952:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587962.340171:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+6:2345:x1875470026125952:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 39us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587962.340177:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 20 00000100:00100000:3.0:1788587962.340189:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 21 00000100:00100000:3.0:1788587962.340197:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:2345:x1875470026125568:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587962.340226:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:2345:x1875470026125568:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 31us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587962.340241:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 21 00000100:00080000:3.0:1788587962.340443:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587962.340448:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587962.340451:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788587962.440528:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788587963.088956:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788587963.322606:0:16489:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdea93a740 20000000:00000080:2.0:1788587963.322623:0:16489:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88f382dcfc00 uarg=0000000000000000 20000000:01000000:2.0:1788587963.322655:0:16489:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788587963.322660:0:16489:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788587963.322664:0:16489:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788587963.326114:0:16490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788587963.327052:0:16489:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788587963.337102:0:16489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788587963.337150:0:16489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587963.337239:0:16489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4bf77aa00/0xa13e120d54ca93b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca93ab expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587963.337261:0:16489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f480031200/0xa13e120d54ca93ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca93f8 expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587963.337267:0:16489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca946f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca9468 expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587963.337277:0:16489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f4bee32a00/0xa13e120d54ca9659 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1522 expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587963.337284:0:16489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88f485ce9000/0xa13e120d54ca9691 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1584 expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587963.337291:0:16489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587963.337330:0:16489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f485ce9000/0xa13e120d54ca9691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1584 expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587963.337344:0:16489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f485ce9000/0xa13e120d54ca9691 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1584 expref: 12 pid: 14369 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587963.337358:0:16489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16489:1875470043938560:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587963.337705:0:16489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4bee32a00/0xa13e120d54ca9659 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1522 expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587963.337713:0:16489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f4bee32a00/0xa13e120d54ca9659 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1522 expref: 12 pid: 14367 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587963.337721:0:16489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16489:1875470043938688:192.168.206.33@tcp:104: 00010000:00010000:2.0:1788587963.337764:0:16489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca946f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca9468 expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587963.337772:0:16489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca946f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca9468 expref: 18 pid: 14367 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587963.337781:0:16489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16489:1875470043938816:0@lo:104: 00000100:00100000:2.0:1788587963.337817:0:16489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587963.337895:0:16489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f480031200/0xa13e120d54ca93ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca93f8 expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587963.337904:0:16489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f480031200/0xa13e120d54ca93ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca93f8 expref: 18 pid: 14369 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587963.337923:0:16489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16489:1875470043938944:0@lo:104: 00000100:00100000:2.0:1788587963.337946:0:16489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587963.337966:0:16489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88f4bf77aa00/0xa13e120d54ca93b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13e120d54ca93ab expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587963.337975:0:16489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88f4bf77aa00/0xa13e120d54ca93b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13e120d54ca93ab expref: 18 pid: 14370 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587963.337983:0:16489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16489:1875470043939072:0@lo:104: 00000100:00100000:2.0:1788587963.338007:0:16489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587963.338017:0:16489:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bab08c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587963.340330:0:14358:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788587963.340350:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043938816 00000100:00100000:1.0:1788587963.340358:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043938816 00000100:00100000:1.0:1788587963.340395:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043938944 00000100:00100000:1.0:1788587963.340397:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043938944 00000100:00100000:1.0:1788587963.340406:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043939072 00000100:00100000:1.0:1788587963.340418:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043939072 00000100:00100000:1.0:1788587963.340433:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587963.340441:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:475e03e7-2028-419a-a63d-caf8ec05d538+5:16489:x1875470043938816:12345-0@lo:104: 00010000:00010000:1.0:1788587963.340457:0:14358:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca946f expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587963.340703:0:14358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788587963.340710:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:475e03e7-2028-419a-a63d-caf8ec05d538+5:16489:x1875470043938816:12345-0@lo:104: Request processed in 269us (2892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587963.340717:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587963.340735:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587963.340741:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:475e03e7-2028-419a-a63d-caf8ec05d538+4:16489:x1875470043938944:12345-0@lo:104: 00010000:00010000:1.0:1788587963.340749:0:14358:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca93ff expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587963.340789:0:14358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788587963.340794:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:475e03e7-2028-419a-a63d-caf8ec05d538+4:16489:x1875470043938944:12345-0@lo:104: Request processed in 55us (2848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587963.340799:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587963.340811:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587963.340827:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f483795c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:475e03e7-2028-419a-a63d-caf8ec05d538+3:16489:x1875470043939072:12345-0@lo:104: 00010000:00010000:1.0:1788587963.340835:0:14358:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca93b2 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587963.340919:0:14358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788587963.340924:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f483795c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:475e03e7-2028-419a-a63d-caf8ec05d538+3:16489:x1875470043939072:12345-0@lo:104: Request processed in 98us (2917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587963.340930:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788587963.341041:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788587963.341048:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca946f expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341056:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030600 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:3.0:1788587963.341059:0:14363:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca946f expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341069:0:14363:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca946f expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587963.341076:0:14363:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca946f expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587963.341082:0:14363:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587963.341119:0:14363:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca946f expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341125:0:14363:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587963.341143:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca946f expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341150:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f480030600/0xa13e120d54ca9468 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca946f expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341171:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587963.341181:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca93ff expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341187:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031400 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:3.0:1788587963.341190:0:14363:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca93ff expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341197:0:14363:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca93ff expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587963.341202:0:14363:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca93ff expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587963.341207:0:14363:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587963.341221:0:14363:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca93ff expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341227:0:14363:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587963.341242:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca93ff expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341248:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f480031400/0xa13e120d54ca93f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca93ff expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341256:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587963.341258:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13e120d54ca93b2 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341263:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031a00 already unused, calling callback (ffffffffc1d4ec20) 10000000:00010000:3.0:1788587963.341265:0:14363:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13e120d54ca93b2 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341281:0:14363:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13e120d54ca93b2 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587963.341287:0:14363:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13e120d54ca93b2 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587963.341292:0:14363:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587963.341305:0:14363:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca93b2 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341310:0:14363:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587963.341317:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca93b2 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341322:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.133@tcp lock: ffff88f480031a00/0xa13e120d54ca93ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13e120d54ca93b2 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341333:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587963.341335:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587963.341336:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587963.341356:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:475e03e7-2028-419a-a63d-caf8ec05d538:3303:1875470043939200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587963.341393:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587963.341438:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:475e03e7-2028-419a-a63d-caf8ec05d538:3304:1875470043939328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587963.341459:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587963.341478:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587963.341484:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:475e03e7-2028-419a-a63d-caf8ec05d538:3304:1875470043939456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587963.341505:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587963.341688:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043939200 00000100:00100000:3.0:1788587963.341698:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043939200 00010000:00010000:3.0:1788587963.341721:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca946f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca9468 expref: 19 pid: 14367 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587963.341738:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043939328 00000100:00100000:3.0:1788587963.341740:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043939328 00010000:00010000:3.0:1788587963.341751:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f480031200/0xa13e120d54ca93ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca93f8 expref: 20 pid: 14369 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587963.341761:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043939456 00000100:00100000:3.0:1788587963.341763:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043939456 00010000:00010000:3.0:1788587963.341772:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4bf77aa00/0xa13e120d54ca93b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca93ab expref: 21 pid: 14370 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587963.341783:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587963.341789:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:475e03e7-2028-419a-a63d-caf8ec05d538+21:3303:x1875470043939200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587963.341800:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587963.341805:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca946f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca9468 expref: 21 pid: 14367 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341814:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca946f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca9468 expref: 21 pid: 14367 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341830:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587963.341889:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:475e03e7-2028-419a-a63d-caf8ec05d538+21:3303:x1875470043939200:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587963.341896:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587963.341920:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587963.341927:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:475e03e7-2028-419a-a63d-caf8ec05d538+20:3304:x1875470043939328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587963.341935:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587963.341946:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f480031200/0xa13e120d54ca93ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca93f8 expref: 20 pid: 14369 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341953:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f480031200/0xa13e120d54ca93ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca93f8 expref: 20 pid: 14369 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.341962:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587963.341989:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:475e03e7-2028-419a-a63d-caf8ec05d538+20:3304:x1875470043939328:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587963.341995:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587963.342008:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587963.342014:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488230850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:475e03e7-2028-419a-a63d-caf8ec05d538+19:3304:x1875470043939456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587963.342021:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587963.342026:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4bf77aa00/0xa13e120d54ca93b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13e120d54ca93ab expref: 19 pid: 14370 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.342034:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4bf77aa00/0xa13e120d54ca93b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13e120d54ca93ab expref: 19 pid: 14370 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.342043:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587963.342064:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488230850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:475e03e7-2028-419a-a63d-caf8ec05d538+19:3304:x1875470043939456:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587963.342070:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587963.342133:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:475e03e7-2028-419a-a63d-caf8ec05d538:3303:1875470043939200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587963.342157:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:475e03e7-2028-419a-a63d-caf8ec05d538:3304:1875470043939456:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587963.342262:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587963.342437:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:475e03e7-2028-419a-a63d-caf8ec05d538:3304:1875470043939328:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587963.342531:0:16489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4c159d800/0xa13e120d54ca946f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca9468 expref: 18 pid: 14367 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587963.342544:0:16489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16489:1875470043938816:0@lo:104: 00010000:00010000:3.0:1788587963.345171:0:16489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f480031200/0xa13e120d54ca93ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca93f8 expref: 17 pid: 14369 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587963.345205:0:16489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16489:1875470043938944:0@lo:104: 00010000:00010000:3.0:1788587963.345221:0:16489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4bf77aa00/0xa13e120d54ca93b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13e120d54ca93ab expref: 16 pid: 14370 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587963.345229:0:16489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16489:1875470043939072:0@lo:104: 00000100:00100000:3.0:1788587963.345241:0:16489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16489:1875470043938560:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587963.345249:0:16489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16489:1875470043938688:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587963.345275:0:16489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587963.346968:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587963.347067:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587963.347174:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026126336 00000100:00100000:0.0:1788587963.347183:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026126336 00010000:00010000:0.0:1788587963.347222:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f485ce9000/0xa13e120d54ca9691 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1584 expref: 13 pid: 14369 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587963.347272:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026126464 00000100:00100000:0.0:1788587963.347275:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026126464 00010000:00010000:0.0:1788587963.347290:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88f4bee32a00/0xa13e120d54ca9659 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1522 expref: 14 pid: 14367 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587963.347307:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:0.0:1788587963.347315:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:652ca569-a046-4217-abb9-8fa30688d32b+14:2344:x1875470026126336:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587963.347328:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587963.347335:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f485ce9000/0xa13e120d54ca9691 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1584 expref: 14 pid: 14369 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347346:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f485ce9000/0xa13e120d54ca9691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1584 expref: 14 pid: 14369 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347362:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f485ce9000/0xa13e120d54ca9691 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1584 expref: 14 pid: 14369 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347376:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587963.347427:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:652ca569-a046-4217-abb9-8fa30688d32b+13:2344:x1875470026126336:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 112us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587963.347434:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:0.0:1788587963.347454:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 8 00000100:00100000:0.0:1788587963.347460:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:652ca569-a046-4217-abb9-8fa30688d32b+12:2344:x1875470026126464:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587963.347468:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587963.347473:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88f4bee32a00/0xa13e120d54ca9659 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1522 expref: 12 pid: 14367 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347493:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88f4bee32a00/0xa13e120d54ca9659 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1522 expref: 12 pid: 14367 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347503:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f4bee32a00/0xa13e120d54ca9659 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1522 expref: 12 pid: 14367 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347653:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347663:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347679:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347687:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347695:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347702:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347708:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce8200 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:0.0:1788587963.347713:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347720:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347742:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.347753:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587963.347775:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:652ca569-a046-4217-abb9-8fa30688d32b+11:2344:x1875470026126464:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 314us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587963.347782:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 8 00010000:00010000:3.0:1788587963.348185:0:16489:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.348196:0:16489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587963.348203:0:16489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88f485ce8200/0xa13e120d54ca96bb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587963.350278:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587964.113703:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788587964.620461:0:14373:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788587964.620468:0:14373:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f4bf84e000 from 10 10000000:01000000:2.0:1788587964.620472:0:14373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587964.620511:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f485ce8e00/0xa13e120d54ca96c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587964.620523:0:14373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f485ce8e00/0xa13e120d54ca96c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587964.620534:0:14373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f485ce8e00/0xa13e120d54ca96c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587964.620555:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043939584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587964.620611:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587964.620648:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486769d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587964.620769:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043939584 00000100:00100000:1.0:1788587964.620776:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043939584 00000100:00100000:1.0:1788587964.620828:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788587964.620837:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+16:14373:x1875470043939584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587964.620867:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587964.620879:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca96c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca96c2 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587964.620900:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca96c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca96c2 expref: 17 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587964.620921:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4856c1200/0xa13e120d54ca96c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca96c2 expref: 17 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587964.620930:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1200, rc 0) 00000100:00100000:1.0:1788587964.620964:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+17:14373:x1875470043939584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587964.620971:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788587964.621052:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043939584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587964.621066:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f485ce8e00/0xa13e120d54ca96c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca96c9 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587964.621147:0:14373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f485ce8e00/0xa13e120d54ca96c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca96c9 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587964.621202:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043939712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587964.621226:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587964.621288:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486769d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587964.623327:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043939712 00000100:00100000:1.0:1788587964.623337:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043939712 00000100:00100000:1.0:1788587964.623383:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788587964.623400:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+17:14373:x1875470043939712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587964.623646:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+17:14373:x1875470043939712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587964.623653:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788587964.623709:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043939712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587964.623754:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043939840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587964.623796:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587964.623823:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f487055600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587964.623837:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043939840 00000100:00100000:1.0:1788587964.623863:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043939840 00000100:00100000:1.0:1788587964.623887:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788587964.623893:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+17:14373:x1875470043939840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587964.624042:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+17:14373:x1875470043939840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587964.624049:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788587964.624216:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043939840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788587964.624915:0:16550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788587964.624962:0:14373:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788587964.624981:0:14373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587964.624991:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f485ce8e00/0xa13e120d54ca96c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca96c9 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587964.625000:0:14373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f485ce8e00/0xa13e120d54ca96c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca96c9 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587964.625010:0:14373:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587964.625012:0:14373:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f48661b800 from 10 10000000:01000000:0.0:1788587964.625015:0:14373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587964.625040:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bee32600/0xa13e120d54ca96d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587964.625048:0:14373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4bee32600/0xa13e120d54ca96d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587964.625056:0:14373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4bee32600/0xa13e120d54ca96d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587964.625099:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043939968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587964.625138:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587964.625157:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bfc68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587964.625174:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043939968 00000100:00100000:0.0:1788587964.625178:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043939968 00000100:00100000:0.0:1788587964.625208:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788587964.625214:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+17:14373:x1875470043939968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587964.625223:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587964.625234:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4bee33c00/0xa13e120d54ca96d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca96d0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587964.625254:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4bee33c00/0xa13e120d54ca96d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca96d0 expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587964.625264:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4bee33c00/0xa13e120d54ca96d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca96d0 expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587964.625272:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bee33c00, rc 0) 00000100:00100000:0.0:1788587964.625302:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+18:14373:x1875470043939968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587964.625308:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788587964.625344:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043939968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587964.625355:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4bee32600/0xa13e120d54ca96d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca96d7 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587964.625364:0:14373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4bee32600/0xa13e120d54ca96d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca96d7 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587964.625412:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043940096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587964.625436:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587964.625448:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bfc68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587964.625459:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043940096 00000100:00100000:0.0:1788587964.625462:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043940096 00000100:00100000:0.0:1788587964.625483:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788587964.625488:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b538f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+18:14373:x1875470043940096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587964.625670:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b538f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+18:14373:x1875470043940096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587964.625677:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788587964.625707:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043940096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587964.625732:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043940224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587964.625766:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587964.625780:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bfc68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587964.625791:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043940224 00000100:00100000:0.0:1788587964.625795:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043940224 00000100:00100000:0.0:1788587964.625815:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788587964.625821:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+18:14373:x1875470043940224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587964.625985:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+18:14373:x1875470043940224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587964.625993:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788587964.626031:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043940224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788587964.626789:0:16551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788587964.626868:0:14373:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788587964.626885:0:14373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587964.626892:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bee32600/0xa13e120d54ca96d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca96d7 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587964.626901:0:14373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4bee32600/0xa13e120d54ca96d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca96d7 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587964.626924:0:14373:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587964.626927:0:14373:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88f381d1d800 from 10 10000000:01000000:0.0:1788587964.626929:0:14373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587964.626952:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bee33000/0xa13e120d54ca96de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587964.626960:0:14373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.133@tcp lock: ffff88f4bee33000/0xa13e120d54ca96de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587964.626968:0:14373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.133@tcp lock: ffff88f4bee33000/0xa13e120d54ca96de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587964.626983:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043940352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587964.627013:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587964.627227:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043940352 00000100:00100000:1.0:1788587964.627231:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043940352 00000100:00100000:1.0:1788587964.627259:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788587964.627265:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+18:14373:x1875470043940352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587964.627273:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587964.627282:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4856c0a00/0xa13e120d54ca96e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13e120d54ca96de expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587964.627300:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4856c0a00/0xa13e120d54ca96e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13e120d54ca96de expref: 19 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587964.627320:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4856c0a00/0xa13e120d54ca96e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13e120d54ca96de expref: 19 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587964.627328:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0a00, rc 0) 00000100:00100000:0.0:1788587964.630253:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bfc68600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587964.630478:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+19:14373:x1875470043940352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3208us (3459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587964.630487:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788587964.633215:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043940352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587964.633242:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.133@tcp lock: ffff88f4bee33000/0xa13e120d54ca96de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca96e5 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587964.633255:0:14373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.133@tcp lock: ffff88f4bee33000/0xa13e120d54ca96de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13e120d54ca96e5 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587964.633348:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043940480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587964.633405:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587964.633446:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bfc68600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587964.640165:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043940480 00000100:00100000:3.0:1788587964.640185:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043940480 00000100:00100000:3.0:1788587964.640272:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788587964.640284:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+19:14373:x1875470043940480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587964.641273:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:475e03e7-2028-419a-a63d-caf8ec05d538+19:14373:x1875470043940480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 986us (7863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587964.641285:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788587964.641946:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043940480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587964.642011:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043940608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587964.642214:0:14373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587964.642253:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043940608 00000100:00100000:0.0:1788587964.642259:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043940608 00000100:00100000:0.0:1788587964.642305:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788587964.642313:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+19:14373:x1875470043940608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587964.642492:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:475e03e7-2028-419a-a63d-caf8ec05d538+19:14373:x1875470043940608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587964.642500:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788587964.642548:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bfc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587964.642561:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f38181f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:475e03e7-2028-419a-a63d-caf8ec05d538:14373:1875470043940608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788587964.657378:0:16554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788587964.658767:0:14373:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788587964.658797:0:14373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587964.658808:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.133@tcp lock: ffff88f4bee33000/0xa13e120d54ca96de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca96e5 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587964.658821:0:14373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.133@tcp lock: ffff88f4bee33000/0xa13e120d54ca96de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13e120d54ca96e5 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587964.959627:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587964.959694:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026126592 00000100:00100000:1.0:1788587964.959703:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026126592 00000100:00100000:1.0:1788587964.959755:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 114 00000100:00100000:1.0:1788587964.959764:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+11:13728:x1875470026126592:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587964.959779:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587964.959795:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4856c1800/0xa13e120d54ca96ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db15b5 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587964.959821:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4856c1800/0xa13e120d54ca96ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15b5 expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587964.959832:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4856c1800/0xa13e120d54ca96ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15b5 expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587964.959864:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1800, rc 0) 00000100:00100000:1.0:1788587964.959923:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+12:13728:x1875470026126592:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 Request processed in 159us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587964.959930:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 114 00000100:00100000:0.0:1788587964.969493:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587964.969596:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026126720 00000100:00100000:3.0:1788587964.969606:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026126720 00000100:00100000:3.0:1788587964.969658:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 115 00000100:00100000:3.0:1788587964.969668:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+12:13728:x1875470026126720:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587964.969973:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+12:13728:x1875470026126720:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 Request processed in 305us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587964.969992:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 115 00000100:00100000:2.0:1788587964.981362:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587964.981487:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026126848 00000100:00100000:0.0:1788587964.981497:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026126848 00000100:00100000:0.0:1788587964.981557:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 116 00000100:00100000:0.0:1788587964.981566:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+12:13728:x1875470026126848:12345-192.168.206.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587964.981794:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+12:13728:x1875470026126848:12345-192.168.206.33@tcp:503:ll_cfg_requeue.0 Request processed in 228us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587964.981802:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 116 00000100:00100000:3.0:1788587964.993555:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587964.994278:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026126976 00000100:00100000:1.0:1788587964.994289:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026126976 00000100:00100000:1.0:1788587964.994355:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 117 00000100:00100000:1.0:1788587964.994365:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+12:13728:x1875470026126976:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587964.994380:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587964.994506:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88f4856c1e00/0xa13e120d54ca96f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x718441a5e1db15bc expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587964.994539:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88f4856c1e00/0xa13e120d54ca96f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15bc expref: 13 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587964.994550:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88f4856c1e00/0xa13e120d54ca96f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15bc expref: 13 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587964.994559:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1e00, rc 0) 00000100:00100000:1.0:1788587964.994617:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:652ca569-a046-4217-abb9-8fa30688d32b+13:13728:x1875470026126976:12345-192.168.206.33@tcp:101:ll_cfg_requeue.0 Request processed in 253us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587964.994623:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 117 00000100:00100000:0.0:1788587964.997783:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587964.998544:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026127104 00000100:00100000:3.0:1788587964.998554:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026127104 00000100:00100000:3.0:1788587964.998606:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 118 00000100:00100000:3.0:1788587964.998616:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+13:13728:x1875470026127104:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587964.999059:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+13:13728:x1875470026127104:12345-192.168.206.33@tcp:501:ll_cfg_requeue.0 Request processed in 442us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587964.999067:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 118 00000100:00100000:2.0:1788587965.003126:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587965.003223:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026127232 00000100:00100000:0.0:1788587965.003232:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026127232 00000100:00100000:0.0:1788587965.003286:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 119 00000100:00100000:0.0:1788587965.003297:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+13:13728:x1875470026127232:12345-192.168.206.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587965.003623:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:652ca569-a046-4217-abb9-8fa30688d32b+13:13728:x1875470026127232:12345-192.168.206.33@tcp:503:ll_cfg_requeue.0 Request processed in 326us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587965.003631:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 119 00010000:00010000:3.0:1788587965.129553:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587966.152010:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587966.895781:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587966.895936:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026127360 00000100:00100000:0.0:1788587966.895948:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026127360 00000100:00100000:0.0:1788587966.896045:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 15 00000100:00100000:0.0:1788587966.896059:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:14382:x1875470026127360:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587966.896089:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587966.896118:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33800/0xa13e120d54ca96fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db15c3 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896213:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca9701 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896253:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca9701 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896270:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca9701 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896287:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9708 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896295:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9708 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896302:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9708 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896693:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32a00/0xa13e120d54ca970f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896703:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32a00/0xa13e120d54ca970f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896712:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32a00/0xa13e120d54ca970f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587966.896742:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587966.896746:0:14376:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587966.896792:0:14376:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32a00/0xa13e120d54ca970f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896804:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca9701 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896821:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca9701 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896828:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca9701 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896835:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bee32e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587966.896885:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca9701 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896906:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca9701 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896920:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f49f9bac00) 00010000:00010000:0.0:1788587966.896924:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587966.896929:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca9701 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896936:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca9701 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896951:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9708 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896957:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9708 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896963:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9708 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896968:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bee33a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587966.896977:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9708 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896984:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9708 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.896992:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88f49f9bab00) 00010000:00010000:0.0:1788587966.896995:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587966.896998:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9708 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.897004:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9708 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.897046:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33800/0xa13e120d54ca96fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15c3 expref: 8 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.897060:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32a00/0xa13e120d54ca970f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15c3 expref: 7 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.897067:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88f49f9ba600) 00010000:00010000:0.0:1788587966.897069:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587966.897072:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bee32a00, rc 0) 00000100:00100000:0.0:1788587966.897153:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+7:14382:x1875470026127360:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 1099us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587966.897162:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 15 00000100:00080000:3.0:1788587966.897585:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587966.911673:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587966.911739:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026127616 00000100:00100000:3.0:1788587966.911752:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026127616 00000100:00100000:3.0:1788587966.911827:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 16 00000100:00100000:3.0:1788587966.911839:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+7:14382:x1875470026127616:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587966.911914:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587966.911944:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9716 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db15ca expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.912060:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca971d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.912077:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca971d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.912092:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca971d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.912110:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9724 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.912117:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9724 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.912124:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9724 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.912524:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca972b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.912534:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca972b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.912541:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca972b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587966.912553:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788587966.915072:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca971d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.915111:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca971d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.915120:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca971d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.915127:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587966.915133:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca971d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.915142:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca971d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.915163:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88f49f9ba600) 00010000:00010000:3.0:1788587966.915167:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587966.915281:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca971d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.915288:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca971d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.915308:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9724 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.915315:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9724 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.915322:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9724 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.915328:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587966.915337:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9724 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.915344:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9724 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.915353:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88f484d44c00) 00010000:00010000:3.0:1788587966.915356:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587966.915359:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9724 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.915366:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9724 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.916788:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9716 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15ca expref: 10 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.916820:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030600/0xa13e120d54ca972b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15ca expref: 9 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.916830:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44000) 00010000:00010000:3.0:1788587966.916833:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587966.916837:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480030600, rc 0) 00000100:00100000:3.0:1788587966.916981:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+9:14382:x1875470026127616:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 5143us (5329us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788587966.916991:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 16 00000100:00100000:0.0:1788587966.920080:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043940736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587966.920174:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587966.920292:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587966.920301:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043940864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587966.920326:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587966.920471:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043940736 00000100:00100000:1.0:1788587966.920482:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043940736 00000100:00100000:1.0:1788587966.920551:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043940864 00000100:00100000:1.0:1788587966.920555:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043940864 00000100:00100000:2.0:1788587966.921905:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587966.921930:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043940736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587966.921987:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587966.922079:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043940736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587966.922087:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587966.922106:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:475e03e7-2028-419a-a63d-caf8ec05d538:3304:1875470043940992:0@lo:400:kworker.0 00000100:00100000:2.0:1788587966.922144:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043941120:0@lo:400:kworker.0 00000100:00100000:3.0:1788587966.922172:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587966.922235:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043941248:0@lo:400:kworker.0 00000100:00100000:2.0:1788587966.922565:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587966.922620:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587966.922639:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587966.922646:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043941376:0@lo:400:kworker.0 00000100:00100000:1.0:1788587966.922744:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788587966.922756:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043940864:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587966.922771:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043941120 00000100:00100000:3.0:1788587966.922779:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043941120 00002000:00000024:1.0:1788587966.922782:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587966.922814:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043941248 00000100:00100000:3.0:1788587966.922817:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043941248 00000100:00100000:1.0:1788587966.922822:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043940864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (2495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587966.922827:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587966.922835:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788587966.922863:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043941120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587966.922873:0:14374:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788587966.922881:0:14374:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788587966.922916:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875470043941120:12345-0@lo:400:kworker.0 Request processed in 75us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587966.922923:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788587966.922938:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788587966.922943:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043941248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587966.922967:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875470043941248:12345-0@lo:400:kworker.0 Request processed in 24us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587966.922972:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788587966.923169:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587966.923175:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587966.923178:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587966.923227:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043940864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587966.923247:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043940736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587966.923302:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587966.923326:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043940992 00000100:00100000:2.0:1788587966.923334:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875470043941248:0@lo:400:kworker.0 00000100:00100000:0.0:1788587966.923334:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043940992 00000100:00100000:2.0:1788587966.923361:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043941376 00000100:00100000:2.0:1788587966.923367:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043941376 00000100:00100000:0.0:1788587966.923378:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788587966.923387:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+19:3304:x1875470043940992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587966.923419:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587966.923427:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043941376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587966.923437:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+19:3304:x1875470043940992:12345-0@lo:400:kworker.0 Request processed in 51us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587966.923456:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788587966.923472:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875470043941376:12345-0@lo:400:kworker.0 Request processed in 45us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587966.923479:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788587966.923494:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587966.923512:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875470043941120:0@lo:400:kworker.0 00000100:00100000:2.0:1788587966.923533:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875470043941376:0@lo:400:kworker.0 00000100:00100000:0.0:1788587966.923605:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:475e03e7-2028-419a-a63d-caf8ec05d538:3304:1875470043940992:0@lo:400:kworker.0 00000100:00100000:2.0:1788587966.934102:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587966.934329:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026127744 00000100:00100000:1.0:1788587966.934340:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026127744 00000100:00100000:1.0:1788587966.934411:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 17 00000100:00100000:1.0:1788587966.934422:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+9:14382:x1875470026127744:12345-192.168.206.33@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788587966.934826:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+9:14382:x1875470026127744:12345-192.168.206.33@tcp:59:lhsmtool_posix.0 Request processed in 404us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587966.934834:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 17 00000100:00100000:0.0:1788587966.957132:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587966.957270:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026127872 00000100:00100000:3.0:1788587966.957283:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026127872 00000100:00100000:3.0:1788587966.957398:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 18 00000100:00100000:3.0:1788587966.957410:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+9:14388:x1875470026127872:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587966.957435:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587966.957473:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9739 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db15d1 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.957570:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9740 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.957595:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.957631:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.957649:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9747 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.957657:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.957664:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.957939:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.957947:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9740 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.957955:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9740 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.957961:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587966.957966:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9740 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.957975:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9740 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.957990:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f49f9bac00) 00010000:00010000:3.0:1788587966.957993:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587966.957999:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9740 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.958012:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca9740 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.958027:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.958033:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9747 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.958038:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9747 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.958043:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587966.958046:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9747 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.958052:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9747 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.958059:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88f484d44c00) 00010000:00010000:3.0:1788587966.958062:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587966.958064:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9747 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.958070:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9747 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.958108:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9739 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15d1 expref: 10 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.958129:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f49f9bac00) 00010000:00010000:3.0:1788587966.958131:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587966.958135:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca9739 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15d1 expref: 10 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587966.958143:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031200, rc 0) 00000100:00100000:3.0:1788587966.958286:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+9:14388:x1875470026127872:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 878us (1170us total) trans 0 rc 301/301 00000100:00100000:3.0:1788587966.958295:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 18 00000100:00100000:0.0:1788587966.969090:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587966.969275:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026128000 00000100:00100000:3.0:1788587966.969288:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026128000 00000100:00100000:3.0:1788587966.969383:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00100000:3.0:1788587966.969464:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+9:14388:x1875470026128000:12345-192.168.206.33@tcp:700:lfs.0 00000100:00100000:3.0:1788587966.969630:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+9:14388:x1875470026128000:12345-192.168.206.33@tcp:700:lfs.0 Request processed in 171us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587966.969639:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00100000:2.0:1788587966.974717:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587966.974994:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026128256 00000100:00100000:1.0:1788587966.975007:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026128256 00000100:00100000:1.0:1788587966.975077:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 19 00000100:00100000:1.0:1788587966.975089:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+9:14388:x1875470026128256:12345-192.168.206.33@tcp:36:lfs.0 00010000:00010000:1.0:1788587966.975813:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587966.975913:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32000/0xa13e120d54ca967c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db154c expref: 9 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.975940:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f49f9bac00) 00010000:00010000:1.0:1788587966.975947:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587966.977995:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.978030:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32c00/0xa13e120d54ca96b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15ae expref: 5 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.978063:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.978121:0:14374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32c00/0xa13e120d54ca96b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15ae expref: 5 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.978139:0:14374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32c00/0xa13e120d54ca96b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15ae expref: 5 pid: 14374 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587966.978170:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14374:1875470043941504:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587966.979764:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486647180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587966.982805:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14374:1875470043941504:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587966.982872:0:14374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587966.983536:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587966.984008:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026128384 00000100:00100000:0.0:1788587966.984018:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026128384 00010000:00010000:0.0:1788587966.984406:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32c00/0xa13e120d54ca96b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15ae expref: 6 pid: 14374 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587966.984464:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00100000:0.0:1788587966.984476:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+6:2345:x1875470026128384:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587966.984506:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587966.984514:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32c00/0xa13e120d54ca96b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15ae expref: 6 pid: 14374 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.984530:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32c00/0xa13e120d54ca96b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15ae expref: 6 pid: 14374 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.984579:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32c00/0xa13e120d54ca96b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15ae expref: 6 pid: 14374 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.984600:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f49f9bac00) 00010000:00010000:0.0:1788587966.984605:0:14362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.984631:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.984640:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.984677:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587966.984751:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+5:2345:x1875470026128384:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 277us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587966.984760:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00080000:2.0:1788587966.985173:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788587966.985570:0:14374:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.985584:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.985636:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9755 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.985650:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.985660:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587966.987767:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788587966.987789:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.987802:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.987810:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.987817:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587966.987822:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.987832:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.987885:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f49f9bac00) 00010000:00010000:1.0:1788587966.987888:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587966.987905:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587966.987911:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca974e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587966.987936:0:14374:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c3187a2 reply state 00000000a3719fc3 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587966.987947:0:14374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587966.988078:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+10:14388:x1875470026128256:12345-192.168.206.33@tcp:36:lfs.0 Request processed in 12986us (13369us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788587966.988101:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 19 00010000:00010000:0.0:1788587966.991052:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.991074:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9755 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.991083:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9755 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.991091:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587966.991096:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9755 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.991127:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9755 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.992282:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88f48fa37300) 00010000:00010000:0.0:1788587966.992294:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587966.992303:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9755 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587966.992314:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca9755 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587967.096114:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587967.096499:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026128512 00000100:00100000:1.0:1788587967.096512:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026128512 00000100:00100000:1.0:1788587967.099546:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 20 00000100:00100000:1.0:1788587967.099580:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+9:14396:x1875470026128512:12345-192.168.206.33@tcp:101:lctl.0 00010000:00010000:1.0:1788587967.099797:0:16601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587967.099830:0:16601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca975c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db15d8 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.099960:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca9763 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.099979:0:16601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca9763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.099993:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca9763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587967.100044:0:16601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587967.100048:0:16601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587967.100413:0:16601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca9763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.100448:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca975c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15d8 expref: 11 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.100471:0:16601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0e00/0xa13e120d54ca9763 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15d8 expref: 10 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.100495:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:1.0:1788587967.100498:0:16601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587967.100502:0:16601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0e00, rc 0) 00000100:00100000:1.0:1788587967.100751:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+10:14396:x1875470026128512:12345-192.168.206.33@tcp:101:lctl.0 Request processed in 1188us (4780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587967.100761:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 20 00000100:00100000:2.0:1788587967.138293:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587967.138525:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026128640 00000100:00100000:3.0:1788587967.138539:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026128640 00000100:00100000:3.0:1788587967.138680:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 21 00000100:00100000:3.0:1788587967.138692:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eadb7a-746b-48ee-a564-eea8a3502288+5:14397:x1875470026128640:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587967.138729:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587967.138756:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca976a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db15df expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.138835:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9771 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.138934:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.138947:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587967.138995:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587967.139000:0:14375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587967.139028:0:14375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.139058:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca976a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15df expref: 7 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.139081:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031a00/0xa13e120d54ca9771 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15df expref: 6 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.139091:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:3.0:1788587967.139095:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587967.139099:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031a00, rc 0) 00000100:00100000:3.0:1788587967.139167:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4eadb7a-746b-48ee-a564-eea8a3502288+6:14397:x1875470026128640:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 478us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587967.139174:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 21 00000100:00100000:0.0:1788587967.149007:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587967.151801:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026128768 00000100:00100000:1.0:1788587967.151822:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026128768 00000100:00100000:1.0:1788587967.151955:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 22 00000100:00100000:1.0:1788587967.151967:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4eadb7a-746b-48ee-a564-eea8a3502288+6:14397:x1875470026128768:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587967.151993:0:16601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587967.152167:0:16601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9778 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db15e6 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152255:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca977f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152271:0:16601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca977f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152284:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca977f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152303:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9786 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152311:0:16601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9786 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152348:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9786 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152528:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca978d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152537:0:16601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca978d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152544:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca978d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587967.152582:0:16601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587967.152587:0:16601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587967.152611:0:16601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca978d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152646:0:16601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca977f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152653:0:16601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca977f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152659:0:16601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca977f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152673:0:16601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587967.152678:0:16601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca977f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152686:0:16601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca977f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152793:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:1.0:1788587967.152796:0:16601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587967.152803:0:16601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca977f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152809:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca977f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152824:0:16601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9786 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152831:0:16601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9786 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152836:0:16601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9786 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152887:0:16601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587967.152902:0:16601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9786 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152910:0:16601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9786 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152917:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88f48fa37500) 00010000:00010000:1.0:1788587967.152919:0:16601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587967.152922:0:16601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9786 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152928:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9786 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152977:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9778 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15e6 expref: 8 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152992:0:16601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca978d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15e6 expref: 7 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.152999:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88f48fa37600) 00010000:00010000:1.0:1788587967.153001:0:16601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587967.153004:0:16601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0000, rc 0) 00000100:00100000:1.0:1788587967.153349:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4eadb7a-746b-48ee-a564-eea8a3502288+7:14397:x1875470026128768:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 1383us (4355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587967.153359:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 22 00000100:00100000:0.0:1788587967.158418:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587967.158508:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026129024 00000100:00100000:1.0:1788587967.158521:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026129024 00000100:00100000:1.0:1788587967.158592:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 23 00000100:00100000:1.0:1788587967.158603:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4eadb7a-746b-48ee-a564-eea8a3502288+7:14397:x1875470026129024:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587967.158628:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587967.158653:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca9794 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db15ed expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587967.158786:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788587967.159002:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca9794 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15ed expref: 9 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.159020:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:1.0:1788587967.159023:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587967.159047:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca9794 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15ed expref: 9 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.159063:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0200, rc 0) 00000100:00100000:1.0:1788587967.159141:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4eadb7a-746b-48ee-a564-eea8a3502288+8:14397:x1875470026129024:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 539us (740us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788587967.159148:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 23 00000100:00100000:2.0:1788587967.165583:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587967.165871:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026129280 00000100:00100000:3.0:1788587967.165884:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026129280 00000100:00100000:3.0:1788587967.165962:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 24 00000100:00100000:3.0:1788587967.165978:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+8:14397:x1875470026129280:12345-192.168.206.33@tcp:36:lfs.0 00010000:00010000:3.0:1788587967.166057:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587967.166130:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0000/0xa13e120d54ca978d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15e6 expref: 8 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.166156:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88f48fa37600) 00010000:00010000:3.0:1788587967.166171:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587967.166205:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.166220:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.166232:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587967.166505:0:14376:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c31deac reply state 00000000ee637871 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587967.166517:0:14376:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788587967.166533:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788587967.166643:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+9:14397:x1875470026129280:12345-192.168.206.33@tcp:36:lfs.0 Request processed in 671us (1075us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788587967.166652:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 24 00010000:00010000:3.0:1788587967.168607:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587967.168618:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00010000:00010000:3.0:1788587967.168625:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.168632:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.168639:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480031200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587967.168651:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.168727:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97a2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.168750:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88f484d44c00) 00010000:00010000:3.0:1788587967.168754:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788587967.168760:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97a2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.168768:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587967.169115:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026129536 00000100:00100000:1.0:1788587967.169128:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026129536 00000100:00100000:0.0:1788587967.169222:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 2 00000100:00100000:0.0:1788587967.169236:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4eadb7a-746b-48ee-a564-eea8a3502288+8:14397:x1875470026129536:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:0.0:1788587967.169639:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4eadb7a-746b-48ee-a564-eea8a3502288+9:14397:x1875470026129536:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 405us (1029us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788587967.169648:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 2 00000100:00100000:0.0:1788587967.173587:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587967.174538:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026129792 00000100:00100000:1.0:1788587967.174552:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026129792 00000100:00100000:1.0:1788587967.174660:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 25 00000100:00100000:1.0:1788587967.174673:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f38181c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4eadb7a-746b-48ee-a564-eea8a3502288+9:14397:x1875470026129792:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587967.174704:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587967.174731:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca97a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db15f4 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.174882:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca97b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.174912:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca97b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.174926:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca97b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.174943:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca97b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.174950:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca97b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.174966:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca97b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587967.175122:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788587967.175240:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca97b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175249:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca97b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175256:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca97b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175262:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587967.175267:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca97b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175275:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca97b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175289:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:1.0:1788587967.175292:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587967.175297:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca97b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175303:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca97b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175318:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca97b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175336:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca97b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175342:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca97b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175348:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587967.175351:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca97b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175358:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca97b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175366:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88f48fa37500) 00010000:00010000:1.0:1788587967.175369:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587967.175372:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca97b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175378:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca97b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175562:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca97a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15f4 expref: 11 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175575:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:1.0:1788587967.175577:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587967.175581:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca97a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15f4 expref: 11 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.175601:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0200, rc 0) 00000100:00100000:1.0:1788587967.175752:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f38181c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4eadb7a-746b-48ee-a564-eea8a3502288+10:14397:x1875470026129792:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 1080us (2179us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788587967.175761:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 25 00010000:00010000:3.0:1788587967.176684:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587967.181328:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587967.181649:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026129920 00000100:00100000:3.0:1788587967.181662:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026129920 00000100:00100000:3.0:1788587967.181740:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 26 00000100:00100000:3.0:1788587967.181753:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+10:14397:x1875470026129920:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:3.0:1788587967.181783:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587967.181814:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97c5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db15fb expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.181972:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca97cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.181990:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca97cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.182003:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca97cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587967.182062:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587967.182067:0:14376:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587967.182088:0:14376:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca97cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.182119:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97c5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15fb expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.182140:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca97cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15fb expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.182150:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88f484d44c00) 00010000:00010000:3.0:1788587967.182153:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587967.182157:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f480031400, rc 0) 00000100:00100000:3.0:1788587967.182230:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+11:14397:x1875470026129920:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 480us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587967.182237:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 26 00000100:00100000:0.0:1788587967.191599:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587967.191680:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026130048 00000100:00100000:1.0:1788587967.191695:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026130048 00000100:00100000:1.0:1788587967.191771:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 3 00000100:00100000:1.0:1788587967.191784:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4eadb7a-746b-48ee-a564-eea8a3502288+11:14397:x1875470026130048:12345-192.168.206.33@tcp:37:lfs.0 00000100:00100000:1.0:1788587967.199648:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4eadb7a-746b-48ee-a564-eea8a3502288+11:14397:x1875470026130048:12345-192.168.206.33@tcp:37:lfs.0 Request processed in 7850us (8386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587967.199666:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 3 00000100:00100000:2.0:1788587967.204629:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587967.204929:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026130304 00000100:00100000:0.0:1788587967.204942:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026130304 00000100:00100000:0.0:1788587967.205138:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 4 00000100:00100000:0.0:1788587967.205150:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf802050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4eadb7a-746b-48ee-a564-eea8a3502288+11:14397:x1875470026130304:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:0.0:1788587967.205539:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf802050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4eadb7a-746b-48ee-a564-eea8a3502288+12:14397:x1875470026130304:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 390us (923us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788587967.205566:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 4 00000100:00100000:0.0:1788587967.263884:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587967.264214:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026130432 00000100:00100000:3.0:1788587967.264228:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026130432 00000100:00100000:3.0:1788587967.264301:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 27 00000100:00100000:3.0:1788587967.264313:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+10:14403:x1875470026130432:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:3.0:1788587967.264338:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587967.264364:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1602 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.264607:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca97da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.264644:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca97da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.264658:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca97da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.264676:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca97e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.264683:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca97e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.264690:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca97e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.264810:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5e00/0xa13e120d54ca97e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.264819:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5e00/0xa13e120d54ca97e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.264826:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5e00/0xa13e120d54ca97e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587967.264899:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587967.264903:0:14375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587967.264949:0:14375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5e00/0xa13e120d54ca97e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.264964:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca97da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.264980:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca97da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.264987:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca97da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.264993:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587967.264998:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca97da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.265006:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca97da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.265249:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:3.0:1788587967.265252:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587967.265258:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca97da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.265265:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030200/0xa13e120d54ca97da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.265285:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca97e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.265290:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca97e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.265296:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca97e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.265301:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f480030800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587967.265311:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca97e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.265318:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca97e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.265326:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88f484d44900) 00010000:00010000:3.0:1788587967.265329:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587967.265332:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca97e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.265338:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480030800/0xa13e120d54ca97e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.266143:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031200/0xa13e120d54ca97d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1602 expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.266171:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5e00/0xa13e120d54ca97e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1602 expref: 11 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.266180:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88f484d44c00) 00010000:00010000:3.0:1788587967.266182:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788587967.266185:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed5e00, rc 0) 00000100:00100000:3.0:1788587967.266283:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+11:14403:x1875470026130432:12345-192.168.206.33@tcp:101:bash.0 Request processed in 1972us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587967.266294:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 27 00000100:00100000:2.0:1788587967.270214:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587967.270774:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026130688 00000100:00100000:3.0:1788587967.270790:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026130688 00000100:00100000:3.0:1788587967.270994:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 28 00000100:00100000:3.0:1788587967.271006:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+11:14403:x1875470026130688:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:3.0:1788587967.271062:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587967.271090:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4400/0xa13e120d54ca97ef lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1609 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.271259:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.271277:0:14376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca97cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15fb expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.271287:0:14376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.271333:0:14376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca97cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15fb expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.271349:0:14376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca97cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15fb expref: 11 pid: 14376 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587967.271366:0:14376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5337800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14376:1875470043941632:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587967.271515:0:14376:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f487a6bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587967.275754:0:14376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5337800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14376:1875470043941632:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587967.275796:0:14376:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587967.277652:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587967.277750:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026130816 00000100:00100000:0.0:1788587967.277761:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026130816 00010000:00010000:0.0:1788587967.277814:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca97cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15fb expref: 12 pid: 14376 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587967.277882:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:0.0:1788587967.277905:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4eadb7a-746b-48ee-a564-eea8a3502288+12:2345:x1875470026130816:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587967.277925:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587967.277933:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca97cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15fb expref: 12 pid: 14376 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587967.277949:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca97cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15fb expref: 12 pid: 14376 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587967.277976:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f480031400/0xa13e120d54ca97cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db15fb expref: 12 pid: 14376 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587967.277997:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88f484d44c00) 00010000:00010000:0.0:1788587967.278002:0:14360:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587967.278028:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587967.278037:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587967.278096:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587967.278161:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4eadb7a-746b-48ee-a564-eea8a3502288+11:2345:x1875470026130816:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 269us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587967.278169:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 10 00010000:00010000:2.0:1788587967.278342:0:14376:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.278351:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.278401:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca97fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.278413:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca97fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.278422:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca97fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.279315:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9a00/0xa13e120d54ca9804 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.279330:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9a00/0xa13e120d54ca9804 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.279340:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9a00/0xa13e120d54ca9804 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587967.279364:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788587967.279399:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.279407:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.279413:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.279419:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788587967.279424:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.279434:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.279448:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88f484d44c00) 00010000:00010000:2.0:1788587967.279452:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587967.279456:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.279464:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4e00/0xa13e120d54ca97f6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587967.279479:0:14376:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebba98d9 reply state 000000000a6bbbf9 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca97fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587967.279489:0:14376:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788587967.279535:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4400/0xa13e120d54ca97ef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1609 expref: 14 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.279568:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9a00/0xa13e120d54ca9804 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1609 expref: 13 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.279577:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:2.0:1788587967.279580:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788587967.279583:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f485ce9a00, rc 0) 00000100:00100000:2.0:1788587967.279654:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+14:14403:x1875470026130688:12345-192.168.206.33@tcp:101:bash.0 Request processed in 8649us (9453us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788587967.279664:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 28 00010000:00010000:1.0:1788587967.290570:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca97fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.290593:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca97fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.290603:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca97fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.290611:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788587967.290618:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca97fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.290628:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca97fd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.290681:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff88f489329200) 00010000:00010000:1.0:1788587967.290684:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587967.290690:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca97fd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.290698:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca97fd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587967.296800:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587967.297188:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026130944 00000100:00100000:1.0:1788587967.297202:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026130944 00000100:00100000:1.0:1788587967.297312:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 29 00000100:00100000:1.0:1788587967.297324:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+13:14403:x1875470026130944:12345-192.168.206.33@tcp:101:bash.0 00010000:00010000:1.0:1788587967.297357:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587967.297400:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca9812 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1610 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.297485:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9819 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.297503:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9819 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.297517:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9819 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587967.297567:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788587967.297573:0:14374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587967.297598:0:14374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9819 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.297630:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9819 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.297660:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca9812 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1610 expref: 15 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.297681:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9819 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1610 expref: 14 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.297690:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:1.0:1788587967.297694:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587967.297698:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1400, rc 0) 00000100:00100000:1.0:1788587967.297834:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+14:14403:x1875470026130944:12345-192.168.206.33@tcp:101:bash.0 Request processed in 512us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587967.297868:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 29 00000100:00100000:0.0:1788587967.301493:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587967.301638:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026131200 00000100:00100000:3.0:1788587967.301651:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026131200 00000100:00100000:3.0:1788587967.301723:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:3.0:1788587967.301755:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+14:14403:x1875470026131200:12345-192.168.206.33@tcp:35:bash.0 00000100:00100000:3.0:1788587967.302350:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+15:14403:x1875470026131200:12345-192.168.206.33@tcp:35:bash.0 Request processed in 594us (866us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788587967.302360:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:0.0:1788587967.379108:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587967.383516:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026131456 00000100:00100000:1.0:1788587967.383537:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026131456 00000100:00100000:1.0:1788587967.383623:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 30 00000100:00100000:1.0:1788587967.383637:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+15:14413:x1875470026131456:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:1.0:1788587967.383672:0:16601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587967.384521:0:16601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca9820 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1617 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587967.384649:0:16601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788587967.385285:0:16601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca9820 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1617 expref: 17 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.385331:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88f48fa37d00) 00010000:00010000:1.0:1788587967.385335:0:16601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587967.385342:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0200/0xa13e120d54ca9820 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1617 expref: 17 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.385361:0:16601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0200, rc 0) 00000100:00100000:1.0:1788587967.386068:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+16:14413:x1875470026131456:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 2427us (6969us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788587967.386080:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 30 00000100:00100000:2.0:1788587967.392229:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587967.392553:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026131712 00000100:00100000:3.0:1788587967.392565:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026131712 00000100:00100000:3.0:1788587967.392631:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:3.0:1788587967.392643:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+16:14413:x1875470026131712:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:2.0:1788587967.393619:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+17:14413:x1875470026131712:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 967us (1392us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788587967.393643:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:0.0:1788587967.456653:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587967.456745:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587967.456915:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587967.456942:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587967.457004:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026131840 00000100:00100000:1.0:1788587967.457018:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026131840 00000100:00100000:1.0:1788587967.457099:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 121 00000100:00100000:1.0:1788587967.457112:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+13:2345:x1875470026131840:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:1.0:1788587967.457206:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:652ca569-a046-4217-abb9-8fa30688d32b+13:2345:x1875470026131840:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 96us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587967.457215:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 121 00000100:00100000:3.0:1788587967.457898:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026131968 00000100:00100000:3.0:1788587967.457908:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026131968 00000100:00100000:3.0:1788587967.457970:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026132224 00000100:00100000:3.0:1788587967.457974:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026132224 00000100:00100000:3.0:1788587967.458000:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:3.0:1788587967.458007:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+5:2345:x1875470026131968:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587967.458060:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+5:2345:x1875470026131968:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 54us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587967.458068:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:3.0:1788587967.458098:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:3.0:1788587967.458105:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4eadb7a-746b-48ee-a564-eea8a3502288+5:2345:x1875470026132224:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:3.0:1788587967.458130:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4eadb7a-746b-48ee-a564-eea8a3502288+5:2345:x1875470026132224:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 25us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587967.458136:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00080000:1.0:1788587967.458557:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587967.458707:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587967.458991:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026132096 00000100:00100000:2.0:1788587967.458998:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026132096 00000100:00100000:2.0:1788587967.459051:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026132352 00000100:00100000:2.0:1788587967.459054:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026132352 00000100:00100000:2.0:1788587967.459087:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 8 00000100:00100000:2.0:1788587967.459097:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+5:2345:x1875470026132096:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587967.459149:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+5:2345:x1875470026132096:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 53us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587967.459157:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 8 00000100:00100000:2.0:1788587967.459173:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00100000:2.0:1788587967.459179:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+5:2345:x1875470026132352:12345-192.168.206.33@tcp:400:kworker.0 00000100:00100000:2.0:1788587967.459216:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4eadb7a-746b-48ee-a564-eea8a3502288+5:2345:x1875470026132352:12345-192.168.206.33@tcp:400:kworker.0 Request processed in 37us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587967.459223:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00080000:0.0:1788587967.459446:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587967.462496:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587967.462720:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026132608 00000100:00100000:2.0:1788587967.462732:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026132608 00000100:00100000:2.0:1788587967.462806:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 31 00000100:00100000:2.0:1788587967.462818:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+17:14416:x1875470026132608:12345-192.168.206.33@tcp:101:lfs.0 00010000:00010000:2.0:1788587967.463616:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587967.463649:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce8600/0xa13e120d54ca982e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db161e expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.463826:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca9835 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.463981:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca9835 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.463996:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca9835 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587967.464011:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788587967.464196:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce8600/0xa13e120d54ca982e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db161e expref: 20 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.464250:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca9835 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db161e expref: 19 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587967.464260:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:2.0:1788587967.464269:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587967.464274:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f485ce9e00, rc 0) 00000100:00100000:2.0:1788587967.464361:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+19:14416:x1875470026132608:12345-192.168.206.33@tcp:101:lfs.0 Request processed in 1544us (1878us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788587967.464370:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 31 00000100:00100000:2.0:1788587967.469774:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587967.469960:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587967.470045:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026132864 00000100:00100000:0.0:1788587967.470057:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026132864 00000100:00100000:0.0:1788587967.470143:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00100000:0.0:1788587967.470156:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+19:2347:x1875470026132864:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587967.470177:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587967.470215:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9e00/0xa13e120d54ca9835 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db161e expref: 19 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587967.470238:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:0.0:1788587967.470247:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587967.470320:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+18:2347:x1875470026132864:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 167us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587967.470328:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00100000:3.0:1788587967.471487:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026132736 00000100:00100000:3.0:1788587967.471498:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026132736 00000100:00100000:3.0:1788587967.471578:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 32 00000100:00100000:3.0:1788587967.471588:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+18:14416:x1875470026132736:12345-192.168.206.33@tcp:54:lfs.0 00010000:00010000:3.0:1788587967.471860:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca9843 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.471881:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca9843 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.471908:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca9843 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.471943:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca9843 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.471950:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca9843 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.471962:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca9843 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.471969:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587967.471975:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca9843 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.471984:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca9843 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.471998:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:3.0:1788587967.472003:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587967.472008:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca9843 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.472026:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca9843 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587967.472121:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+18:14416:x1875470026132736:12345-192.168.206.33@tcp:54:lfs.0 Request processed in 535us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587967.472130:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 32 00000100:00100000:2.0:1788587967.474989:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587967.475124:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026133120 00000100:00100000:0.0:1788587967.475153:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026133120 00000100:00100000:0.0:1788587967.475221:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:0.0:1788587967.475233:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+18:14416:x1875470026133120:12345-192.168.206.33@tcp:35:lfs.0 00000100:00100000:0.0:1788587967.475545:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+19:14416:x1875470026133120:12345-192.168.206.33@tcp:35:lfs.0 Request processed in 313us (568us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788587967.475553:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 7 00000040:00080000:0.0:1788587967.560610:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788587967.752359:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587967.752942:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026133376 00000100:00100000:1.0:1788587967.752956:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026133376 00000100:00100000:1.0:1788587967.753090:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 33 00000100:00100000:1.0:1788587967.753103:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+19:14447:x1875470026133376:12345-192.168.206.33@tcp:101:cat.0 00010000:00010000:1.0:1788587967.753133:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587967.753161:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca984a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1625 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.753457:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9851 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.753475:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9851 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.753493:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9851 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587967.753506:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788587967.754285:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca984a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1625 expref: 22 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.754313:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9851 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1625 expref: 21 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.754393:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:1.0:1788587967.754398:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587967.754403:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0c00, rc 0) 00000100:00100000:1.0:1788587967.754492:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+21:14447:x1875470026133376:12345-192.168.206.33@tcp:101:cat.0 Request processed in 1391us (2148us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788587967.754502:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 33 00000100:00100000:3.0:1788587967.760660:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587967.760773:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026133504 00000100:00100000:1.0:1788587967.760787:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026133504 00000100:00100000:1.0:1788587967.760906:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 1 00000100:00100000:1.0:1788587967.760919:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5337100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+21:2345:x1875470026133504:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587967.760942:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587967.760989:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9851 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1625 expref: 21 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.761011:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:1.0:1788587967.761017:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587967.761087:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5337100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+20:2345:x1875470026133504:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 170us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587967.761096:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 1 00000100:00100000:2.0:1788587967.763058:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587967.763235:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026133760 00000100:00100000:1.0:1788587967.763247:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026133760 00000100:00100000:1.0:1788587967.763404:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 8 00000100:00100000:1.0:1788587967.763416:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+20:14447:x1875470026133760:12345-192.168.206.33@tcp:35:cat.0 00000100:00100000:1.0:1788587967.763974:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+21:14447:x1875470026133760:12345-192.168.206.33@tcp:35:cat.0 Request processed in 555us (926us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788587967.763989:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 8 00000100:00100000:0.0:1788587967.852168:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587967.852290:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026134016 00000100:00100000:1.0:1788587967.852304:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026134016 00000100:00100000:1.0:1788587967.852378:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 34 00000100:00100000:1.0:1788587967.852559:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+21:14453:x1875470026134016:12345-192.168.206.33@tcp:101:dd.0 00010000:00010000:1.0:1788587967.852591:0:16601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587967.852621:0:16601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca985f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db162c expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.853555:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9866 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.853594:0:16601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9a00/0xa13e120d54ca9804 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1609 expref: 22 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.853733:0:16601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9819 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1610 expref: 22 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.853742:0:16601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9866 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.853787:0:16601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9819 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1610 expref: 22 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.853806:0:16601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9819 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1610 expref: 22 pid: 14374 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587967.853823:0:16601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16601:1875470043941760:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587967.854265:0:16601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9a00/0xa13e120d54ca9804 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1609 expref: 22 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.854277:0:16601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9a00/0xa13e120d54ca9804 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1609 expref: 22 pid: 14376 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587967.854286:0:16601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4c95880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16601:1875470043941888:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587967.854314:0:16601:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f486647000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587967.858988:0:16601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16601:1875470043941760:192.168.206.33@tcp:104: 00000100:00100000:1.0:1788587967.860302:0:16601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4c95880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16601:1875470043941888:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587967.860346:0:16601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9866 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587967.863785:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587967.864295:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026134144 00000100:00100000:0.0:1788587967.864308:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026134144 00000100:00100000:2.0:1788587967.864515:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00010000:00010000:0.0:1788587967.865630:0:14361:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9819 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1610 expref: 23 pid: 14374 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587967.866005:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026134272 00000100:00100000:1.0:1788587967.866016:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026134272 00010000:00010000:1.0:1788587967.866132:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9a00/0xa13e120d54ca9804 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1609 expref: 24 pid: 14376 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587967.866243:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:1.0:1788587967.866263:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f488127050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+24:2344:x1875470026134144:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587967.866282:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587967.866290:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9819 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1610 expref: 24 pid: 14374 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.866306:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9819 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1610 expref: 24 pid: 14374 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.866331:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1400/0xa13e120d54ca9819 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1610 expref: 24 pid: 14374 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.866351:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:1.0:1788587967.866357:0:14360:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9866 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.866367:0:14360:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9866 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.866375:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587967.866456:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f488127050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+23:2344:x1875470026134144:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 203us (2687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587967.866484:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:1.0:1788587967.866556:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 12 00000100:00100000:1.0:1788587967.866564:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382306300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+22:2344:x1875470026134272:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587967.866587:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587967.866593:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9a00/0xa13e120d54ca9804 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1609 expref: 22 pid: 14376 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.866603:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9a00/0xa13e120d54ca9804 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1609 expref: 22 pid: 14376 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.866615:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9a00/0xa13e120d54ca9804 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1609 expref: 22 pid: 14376 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.866626:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:1.0:1788587967.866630:0:14360:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9866 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.866638:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9866 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.866646:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9866 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.866688:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587967.866708:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382306300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+21:2344:x1875470026134272:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 144us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587967.866715:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 12 00010000:00010000:1.0:1788587967.866751:0:16601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9866 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.866760:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9866 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587967.866782:0:16601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788587967.867048:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca985f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db162c expref: 22 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.867733:0:16601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c1600/0xa13e120d54ca9866 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db162c expref: 21 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.867749:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:1.0:1788587967.867752:0:16601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788587967.867811:0:16601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c1600, rc 0) 00000100:00100000:1.0:1788587967.867916:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+21:14453:x1875470026134016:12345-192.168.206.33@tcp:101:dd.0 Request processed in 15362us (15762us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788587967.867926:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 34 00000100:00100000:2.0:1788587967.870814:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587967.872007:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026134528 00000100:00100000:3.0:1788587967.872024:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026134528 00000100:00100000:3.0:1788587967.872107:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 35 00000100:00100000:3.0:1788587967.872119:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+21:14453:x1875470026134528:12345-192.168.206.33@tcp:36:dd.0 00010000:00010000:3.0:1788587967.872472:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9874 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.872494:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9874 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.872508:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9874 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788587967.872602:0:14375:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788587967.872644:0:14375:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ff45561 reply state 00000000c38d5ffb transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9874 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587967.872655:0:14375:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587967.872989:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+24:14453:x1875470026134528:12345-192.168.206.33@tcp:36:dd.0 Request processed in 867us (2180us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788587967.873003:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 35 00000020:00080000:3.0:1788587967.873009:0:14375:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788587967.885620:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587967.886155:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026134656 00000100:00100000:0.0:1788587967.886169:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026134656 00000100:00100000:0.0:1788587967.886245:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 36 00000100:00100000:0.0:1788587967.886258:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+24:14453:x1875470026134656:12345-192.168.206.33@tcp:101:dd.0 00010000:00010000:0.0:1788587967.886291:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587967.886319:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca987b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1633 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587967.886542:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca987b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1633 expref: 25 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587967.886561:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca987b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1633 expref: 25 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587967.886625:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:0.0:1788587967.886629:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587967.886634:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bee32e00, rc 0) 00000100:00100000:0.0:1788587967.887052:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+25:14453:x1875470026134656:12345-192.168.206.33@tcp:101:dd.0 Request processed in 794us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587967.887061:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 36 00010000:00010000:3.0:1788587967.890714:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9874 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.890738:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9874 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.890748:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9874 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.890755:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587967.890760:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9874 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.890769:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9874 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.890792:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:3.0:1788587967.890796:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587967.890801:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9874 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.890808:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9874 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587967.901480:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587967.901606:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026134912 00000100:00100000:1.0:1788587967.901619:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026134912 00000100:00100000:1.0:1788587967.901701:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 2 00000100:00100000:1.0:1788587967.901724:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f382304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+24:14453:x1875470026134912:12345-192.168.206.33@tcp:103:dd.0 00010000:00010000:1.0:1788587967.901746:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587967.901777:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca987b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1633 expref: 24 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.901802:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:1.0:1788587967.901825:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587967.901982:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f382304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+23:14453:x1875470026134912:12345-192.168.206.33@tcp:103:dd.0 Request processed in 260us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587967.901990:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 2 00000100:00100000:2.0:1788587967.913107:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587967.913332:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026135040 00000100:00100000:3.0:1788587967.913345:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026135040 00000100:00100000:3.0:1788587967.913948:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 37 00000100:00100000:3.0:1788587967.913963:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+23:14453:x1875470026135040:12345-192.168.206.33@tcp:58:dd.0 00010000:00010000:3.0:1788587967.914098:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9882 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.914121:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9882 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587967.914155:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9882 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587967.916831:0:14375:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587967.917193:0:14375:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788587967.917284:0:14375:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788587967.918010:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+23:14453:x1875470026135040:12345-192.168.206.33@tcp:58:dd.0 Request processed in 4038us (4906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587967.918025:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 37 00000100:00100000:3.0:1788587967.924120:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587967.924659:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026135168 00000100:00100000:1.0:1788587967.924675:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026135168 00000100:00100000:1.0:1788587967.925056:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 38 00000100:00100000:1.0:1788587967.925074:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+23:14453:x1875470026135168:12345-192.168.206.33@tcp:101:dd.0 00010000:00010000:1.0:1788587967.925104:0:16601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587967.925133:0:16601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9889 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db163a expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.925242:0:16601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9882 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.925256:0:16601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9889 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db163a expref: 24 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.925283:0:16601:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9882 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.925299:0:16601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9889 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db163a expref: 24 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.925316:0:16601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:1.0:1788587967.925320:0:16601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587967.925324:0:16601:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9889 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db163a expref: 24 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587967.925344:0:16601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4856c0c00, rc 0) 00000100:00100000:1.0:1788587967.925429:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+24:14453:x1875470026135168:12345-192.168.206.33@tcp:101:dd.0 Request processed in 360us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587967.926593:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 38 00010000:00010000:3.0:1788587968.200325:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587968.584300:0:14406:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788587968.584313:0:14406:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587968.584357:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788587968.584368:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788587968.585247:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa51880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14406:1875470043942016:192.168.206.33@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587968.585397:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f4bf713840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587968.592000:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa51880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14406:1875470043942016:192.168.206.33@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788587968.595997:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587968.598783:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026135296 00000100:00100000:3.0:1788587968.598808:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026135296 00000100:00100000:3.0:1788587968.599077:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00100000:3.0:1788587968.599109:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+24:14455:x1875470026135296:12345-192.168.206.33@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788587968.599245:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+24:14455:x1875470026135296:12345-192.168.206.33@tcp:900:lhsmtool_posix.0 Request processed in 142us (3262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587968.599253:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00080000:0.0:1788587968.601079:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587968.601451:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587968.601606:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026135424 00000100:00100000:2.0:1788587968.601620:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026135424 00000100:00100000:2.0:1788587968.601723:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 39 00000100:00100000:2.0:1788587968.601739:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+24:14455:x1875470026135424:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788587968.601785:0:14374:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587968.602012:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+24:14455:x1875470026135424:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 Request processed in 275us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587968.602045:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 39 00000100:00100000:2.0:1788587968.611834:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587968.612121:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026135552 00000100:00100000:0.0:1788587968.612133:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026135552 00000100:00100000:0.0:1788587968.612207:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 40 00000100:00100000:0.0:1788587968.612219:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+24:14455:x1875470026135552:12345-192.168.206.33@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788587968.612309:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9890 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.612328:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9890 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.612341:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9890 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.614676:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33800/0xa13e120d54ca9897 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.614699:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33800/0xa13e120d54ca9897 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.614712:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33800/0xa13e120d54ca9897 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.614745:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca989e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.614754:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca989e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.614760:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca989e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587968.615401:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788587968.615483:0:14376:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587968.615498:0:14376:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca989e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615582:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9890 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615590:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9890 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615597:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9890 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615620:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bee33a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587968.615625:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9890 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615632:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9890 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615644:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44000) 00010000:00010000:0.0:1788587968.615647:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587968.615651:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9890 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615657:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9890 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615672:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33800/0xa13e120d54ca9897 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615678:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33800/0xa13e120d54ca9897 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615684:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33800/0xa13e120d54ca9897 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615689:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bee33800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587968.615691:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33800/0xa13e120d54ca9897 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615697:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33800/0xa13e120d54ca9897 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615711:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff88f49f9bab00) 00010000:00010000:0.0:1788587968.615714:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587968.615717:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33800/0xa13e120d54ca9897 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615722:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33800/0xa13e120d54ca9897 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615736:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca989e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615742:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca989e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615747:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca989e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615752:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bee32400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587968.615755:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca989e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615761:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca989e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615767:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:0.0:1788587968.615769:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587968.615772:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca989e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.615777:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca989e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587968.615979:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+24:14455:x1875470026135552:12345-192.168.206.33@tcp:34:lhsmtool_posix.0 Request processed in 3752us (4151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587968.615989:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 40 00000100:00100000:1.0:1788587968.622032:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587968.622588:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026135808 00000100:00100000:0.0:1788587968.622602:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026135808 00000100:00100000:0.0:1788587968.622661:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 41 00000100:00100000:0.0:1788587968.622672:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+24:14455:x1875470026135808:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587968.622694:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587968.622715:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33200/0xa13e120d54ca98a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1641 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.622813:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca98ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.622828:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca98ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.622839:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca98ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587968.622880:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788587968.622983:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca98ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.622991:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca98ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.622997:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca98ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.623019:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bee32e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587968.623023:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca98ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.623032:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca98ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.623044:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:0.0:1788587968.623047:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788587968.623051:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca98ac lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.623058:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca98ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.623097:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33200/0xa13e120d54ca98a5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1641 expref: 26 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.623107:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88f484d44000) 00010000:00010000:0.0:1788587968.623110:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587968.623113:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33200/0xa13e120d54ca98a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1641 expref: 26 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.623123:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bee33200, rc 0) 00000100:00100000:0.0:1788587968.623180:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+25:14455:x1875470026135808:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 510us (1161us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788587968.623188:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 41 00000100:00100000:0.0:1788587968.629591:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587968.629821:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026135936 00000100:00100000:3.0:1788587968.629832:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026135936 00000100:00100000:3.0:1788587968.630291:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 42 00000100:00100000:3.0:1788587968.630309:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+25:14455:x1875470026135936:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788587968.630344:0:14376:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788587968.630447:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+25:14455:x1875470026135936:12345-192.168.206.33@tcp:53:lhsmtool_posix.0 Request processed in 146us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587968.630457:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 42 00000100:00100000:1.0:1788587968.633825:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587968.634159:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026136192 00000100:00100000:2.0:1788587968.634235:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026136192 00000100:00100000:2.0:1788587968.634300:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 43 00000100:00100000:2.0:1788587968.634310:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+25:14455:x1875470026136192:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587968.634329:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587968.634348:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9c00/0xa13e120d54ca98ba lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1648 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587968.641108:0:14374:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1788587968.641119:0:14374:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788587968.641190:0:14374:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788587968.641490:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce8800/0xa13e120d54ca98c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.641506:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce8800/0xa13e120d54ca98c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.642054:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce8800/0xa13e120d54ca98c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.642129:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9c00/0xa13e120d54ca98ba lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1648 expref: 28 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.642148:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce8800/0xa13e120d54ca98c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1648 expref: 27 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.642184:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88f489329300) 00010000:00010000:2.0:1788587968.642188:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587968.642191:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f485ce8800, rc 0) 00000100:00100000:2.0:1788587968.642250:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+27:14455:x1875470026136192:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 7941us (8433us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788587968.642259:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 43 00000100:00100000:2.0:1788587968.647012:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587968.647112:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026136448 00000100:00100000:3.0:1788587968.647128:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026136448 00000100:00100000:3.0:1788587968.647276:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 44 00000100:00100000:3.0:1788587968.647289:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+27:14455:x1875470026136448:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788587968.647763:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587968.647798:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce8800/0xa13e120d54ca98c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1648 expref: 27 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.647823:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88f489329300) 00010000:00010000:3.0:1788587968.647838:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587968.647919:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca98cf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.647936:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca98cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.647947:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca98cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650337:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xee3e60a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650360:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xee3e60a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650373:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xee3e60a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650440:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca98cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650447:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca98cf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650453:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca98cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650471:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587968.650475:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca98cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650482:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca98cf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650495:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88f484d44c00) 00010000:00010000:3.0:1788587968.650497:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587968.650501:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca98cf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650507:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4a00/0xa13e120d54ca98cf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650521:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xee3e60a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650527:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xee3e60a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650533:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xee3e60a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650538:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587968.650541:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xee3e60a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650547:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98d6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xee3e60a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650564:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xee3e60a (ffff88f484d44900) 00010000:00010000:3.0:1788587968.650566:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587968.650569:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98d6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xee3e60a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.650575:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98d6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xee3e60a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587968.650675:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+26:14455:x1875470026136448:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 3385us (3667us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587968.650684:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 44 00000100:00100000:0.0:1788587968.656151:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587968.658916:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026136576 00000100:00100000:2.0:1788587968.658930:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026136576 00000100:00100000:0.0:1788587968.662449:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 45 00000100:00100000:0.0:1788587968.662464:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+26:14455:x1875470026136576:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587968.662484:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587968.662508:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca98dd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db164f expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.662544:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca98e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.662557:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca98e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.662567:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca98e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.662667:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca98dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db164f expref: 28 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.662687:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32400/0xa13e120d54ca98e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db164f expref: 27 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.662696:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88f49f9bab00) 00010000:00010000:0.0:1788587968.662700:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587968.662703:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bee32400, rc 0) 00000100:00100000:0.0:1788587968.662770:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+27:14455:x1875470026136576:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 309us (6629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587968.662778:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 45 00000100:00100000:1.0:1788587968.668693:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587968.670931:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026136832 00000100:00100000:2.0:1788587968.670943:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026136832 00000100:00100000:2.0:1788587968.671252:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 46 00000100:00100000:2.0:1788587968.671264:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+27:14455:x1875470026136832:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587968.671346:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9c00/0xa13e120d54ca98eb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.671363:0:16601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9c00/0xa13e120d54ca98eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.672275:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9c00/0xa13e120d54ca98eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587968.673479:0:16601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788587968.673494:0:16601:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 415928651105ns, next at 416928648566ns, rc = 0 00000004:00010000:2.0:1788587968.673584:0:16601:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b727fd47 reply state 0000000064e35018 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9c00/0xa13e120d54ca98eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587968.673611:0:16601:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587968.673740:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+29:14455:x1875470026136832:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 2475us (5052us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788587968.673748:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 46 00010000:00010000:0.0:1788587968.676940:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9c00/0xa13e120d54ca98eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.676955:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9c00/0xa13e120d54ca98eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.676963:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9c00/0xa13e120d54ca98eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.676977:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788587968.676982:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9c00/0xa13e120d54ca98eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.676989:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9c00/0xa13e120d54ca98eb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.677005:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88f49f9bab00) 00010000:00010000:0.0:1788587968.677008:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788587968.677013:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9c00/0xa13e120d54ca98eb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.677019:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9c00/0xa13e120d54ca98eb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587968.677207:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587968.677619:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026136960 00000100:00100000:3.0:1788587968.677628:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026136960 00000100:00100000:3.0:1788587968.677712:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 47 00000100:00100000:3.0:1788587968.677722:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+28:14455:x1875470026136960:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587968.677743:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587968.677759:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1656 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.677809:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1656 expref: 29 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.677822:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1656 expref: 29 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.677837:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88f49f9bab00) 00010000:00010000:3.0:1788587968.677858:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587968.677874:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed4600, rc 0) 00000100:00100000:3.0:1788587968.677936:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+29:14455:x1875470026136960:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 215us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587968.677943:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 47 00000100:00100000:0.0:1788587968.681305:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587968.681612:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026137088 00000100:00100000:2.0:1788587968.681621:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026137088 00000100:00100000:2.0:1788587968.681674:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:2.0:1788587968.681685:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+5:2344:x1875470026137088:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788587968.682057:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:2344:x1875470026137088:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 Request processed in 372us (759us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788587968.682065:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:1.0:1788587968.686581:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587968.686659:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026137344 00000100:00100000:0.0:1788587968.686668:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026137344 00000100:00100000:0.0:1788587968.686736:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00100000:0.0:1788587968.686748:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+29:14455:x1875470026137344:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788587968.687005:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+30:14455:x1875470026137344:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 Request processed in 258us (432us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788587968.687030:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 9 00000100:00100000:1.0:1788587968.691871:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587968.692151:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026137600 00000100:00100000:3.0:1788587968.692161:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026137600 00000100:00100000:3.0:1788587968.692222:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 48 00000100:00100000:3.0:1788587968.692232:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+30:14455:x1875470026137600:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788587968.692342:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+30:14455:x1875470026137600:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 111us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587968.692351:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 48 00000100:00100000:3.0:1788587968.694503:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587968.694708:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026137728 00000100:00100000:0.0:1788587968.694717:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026137728 00000100:00100000:0.0:1788587968.694770:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 49 00000100:00100000:0.0:1788587968.694780:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+30:14455:x1875470026137728:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587968.694798:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587968.694818:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca98f9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db165d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.694933:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9900 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.694947:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9900 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.694960:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9900 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587968.700498:0:14375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587968.700541:0:14375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9900 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587968.700590:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee32e00/0xa13e120d54ca98f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db165d expref: 32 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587968.700613:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9900 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db165d expref: 31 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587968.700622:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88f49f9bab00) 00010000:00010000:1.0:1788587968.700626:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788587968.700630:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4bee33a00, rc 0) 00000100:00100000:1.0:1788587968.700831:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+31:14455:x1875470026137728:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 6050us (6334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587968.700840:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 49 00000100:00100000:1.0:1788587968.712084:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587968.715140:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026137856 00000100:00100000:3.0:1788587968.715155:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026137856 00000100:00100000:3.0:1788587968.715263:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:3.0:1788587968.715275:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:2345:x1875470026137856:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587968.715291:0:15061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587968.715311:0:15061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097538888/0xa13e120d54ca9907 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x718441a5e1db1664 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587968.715338:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bafbf, blocks: 0x1 00010000:00010000:3.0:1788587968.715355:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1788587968.715360:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587968.715370:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097538888/0xa13e120d54ca9907 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1664 expref: 7 pid: 15061 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.715411:0:15061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097538888/0xa13e120d54ca9907 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1664 expref: 7 pid: 15061 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.715441:0:15061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88f4baed4a00, rc 0) 00000100:00100000:3.0:1788587968.715507:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+7:2345:x1875470026137856:12345-192.168.206.33@tcp:101:lhsmtool_posix.0 Request processed in 235us (3431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587968.715514:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:2.0:1788587968.720371:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587968.720493:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026138112 00000100:00100000:3.0:1788587968.720503:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026138112 00000100:00100000:3.0:1788587968.720556:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 50 00000100:00100000:3.0:1788587968.720566:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+31:14455:x1875470026138112:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788587968.720670:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+31:14455:x1875470026138112:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 106us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587968.720679:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 50 00000100:00100000:0.0:1788587968.724750:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587968.724831:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026138240 00000100:00100000:3.0:1788587968.724872:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026138240 00000100:00100000:3.0:1788587968.724940:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 51 00000100:00100000:3.0:1788587968.724951:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+31:14455:x1875470026138240:12345-192.168.206.33@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788587968.758927:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1788587968.758947:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:1.0:1788587968.758972:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788587968.759208:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4baa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043942144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788587968.759274:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587968.759458:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043942144 00000100:00100000:0.0:1788587968.759467:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043942144 00000100:00100000:0.0:1788587968.759522:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587968.759531:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875470043942144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788587968.759679:0:15062:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788587968.759683:0:15062:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788587968.759685:0:15062:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788587968.759687:0:15062:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788587967 -> 1788587967 00002000:00010000:0.0:1788587968.759689:0:15062:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:1.0:1788587968.759787:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587968.760082:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+14:14455:x1875470026138240:12345-192.168.206.33@tcp:44:lhsmtool_posix.0 Request processed in 35130us (35339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587968.760090:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 51 00000100:00100000:0.0:1788587968.760148:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875470043942144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 618us (874us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788587968.760155:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587968.763054:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587968.763128:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026138368 00000100:00100000:3.0:1788587968.763139:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026138368 00000100:00100000:3.0:1788587968.763229:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 13 00000100:00100000:3.0:1788587968.763239:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+7:2344:x1875470026138368:12345-192.168.206.33@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788587968.763342:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+7:2344:x1875470026138368:12345-192.168.206.33@tcp:16:lhsmtool_posix.0 Request processed in 105us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587968.763362:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 13 00000004:00080000:1.0:1788587968.763454:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88f4baa50000/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788587968.763462:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4baa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875470043942144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788587968.766258:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587968.766357:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026138624 00000100:00100000:3.0:1788587968.766365:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026138624 00000100:00100000:3.0:1788587968.766568:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 52 00000100:00100000:3.0:1788587968.766579:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+14:14455:x1875470026138624:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788587968.766626:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587968.766653:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4bee33a00/0xa13e120d54ca9900 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db165d expref: 14 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.766671:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88f49f9bab00) 00010000:00010000:3.0:1788587968.766676:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587968.766714:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca990e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.766727:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca990e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.766736:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca990e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587968.766967:0:14376:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd8fa790 reply state 00000000d33dc3fd transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca990e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587968.766976:0:14376:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587968.767053:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+15:14455:x1875470026138624:12345-192.168.206.33@tcp:36:lhsmtool_posix.0 Request processed in 476us (804us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788587968.767061:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 52 00000100:00100000:2.0:1788587968.770828:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00010000:00010000:3.0:1788587968.771052:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca990e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.771076:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca990e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.771084:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca990e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.771090:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587968.771095:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca990e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.771103:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca990e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.771120:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88f49f9bab00) 00010000:00010000:3.0:1788587968.771123:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587968.771128:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca990e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.771135:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca990e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587968.771189:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026138752 00000100:00100000:1.0:1788587968.771198:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026138752 00000100:00100000:1.0:1788587968.771293:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 14 00000100:00100000:1.0:1788587968.771303:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+7:2345:x1875470026138752:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788587968.771506:0:15059:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788587968.771510:0:15059:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788587966 00002000:00010000:1.0:1788587968.771512:0:15059:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788587966 00002000:00010000:1.0:1788587968.771515:0:15059:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788587967 -> 1788587966 00002000:00010000:1.0:1788587968.771517:0:15059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788587968.771576:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+8:2345:x1875470026138752:12345-192.168.206.33@tcp:2:lhsmtool_posix.0 Request processed in 273us (755us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788587968.771584:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 14 00000100:00100000:2.0:1788587968.773918:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587968.774297:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026138880 00000100:00100000:0.0:1788587968.774306:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026138880 00000100:00100000:0.0:1788587968.774407:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 15 00000100:00100000:0.0:1788587968.774417:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+8:2344:x1875470026138880:12345-192.168.206.33@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788587968.774458:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb73fc13/0xa13e120d54ca9915 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.774474:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788587968.774479:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587968.774485:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb73fc13/0xa13e120d54ca9915 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.774502:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb73fc13/0xa13e120d54ca9915 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.774529:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb73fc13/0xa13e120d54ca9915 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.774536:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb73fc13/0xa13e120d54ca9915 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.774543:0:15062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb73fc13/0xa13e120d54ca9915 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.774567:0:15062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4bee32000 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:0.0:1788587968.774572:0:15062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb73fc13/0xa13e120d54ca9915 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.774581:0:15062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb73fc13/0xa13e120d54ca9915 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.774596:0:15062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb73fc13/0xa13e120d54ca9915 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.774604:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb73fc13/0xa13e120d54ca9915 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587968.774670:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+8:2344:x1875470026138880:12345-192.168.206.33@tcp:1:lhsmtool_posix.0 Request processed in 254us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587968.774677:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 15 00000100:00100000:2.0:1788587968.777118:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587968.777261:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026139136 00000100:00100000:3.0:1788587968.777270:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026139136 00000100:00100000:3.0:1788587968.777318:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 53 00000100:00100000:3.0:1788587968.777327:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+14:14455:x1875470026139136:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788587968.777468:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5c00/0xa13e120d54ca991c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.777485:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5c00/0xa13e120d54ca991c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.777514:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5c00/0xa13e120d54ca991c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.777835:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.778464:0:14375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98f2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1656 expref: 15 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.778473:0:14375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.778608:0:14375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1656 expref: 15 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.778623:0:14375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98f2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1656 expref: 15 pid: 14374 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587968.778637:0:14375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4a67800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14375:1875470043942272:192.168.206.33@tcp:104: 00000100:00100000:2.0:1788587968.779023:0:14375:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f487b399c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587968.783162:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587968.783251:0:14375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4a67800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14375:1875470043942272:192.168.206.33@tcp:104: 00010000:00010000:1.0:1788587968.783277:0:14375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587968.783338:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026139264 00000100:00100000:3.0:1788587968.783345:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026139264 00010000:00010000:3.0:1788587968.783510:0:14361:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98f2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1656 expref: 16 pid: 14374 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587968.783549:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 13 00000100:00100000:3.0:1788587968.783560:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+16:2345:x1875470026139264:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587968.783574:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587968.783581:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98f2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1656 expref: 16 pid: 14374 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.783594:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1656 expref: 16 pid: 14374 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.783614:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4600/0xa13e120d54ca98f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1656 expref: 16 pid: 14374 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.783647:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88f49f9bab00) 00010000:00010000:3.0:1788587968.783652:0:14361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.783660:0:14361:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.783668:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.783826:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587968.783907:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+15:2345:x1875470026139264:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 349us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587968.783915:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 13 00010000:00010000:2.0:1788587968.785210:0:14375:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.785222:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587968.785565:0:14375:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788587968.785784:0:14375:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788587968.785831:0:14375:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788587968.786055:0:14375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4a67100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14375:1875470043942400:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788587968.786179:0:14375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587968.786207:0:14375:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f487b39e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587968.786282:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043942400 00000100:00100000:0.0:1788587968.786290:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043942400 00000100:00100000:0.0:1788587968.786334:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587968.786343:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14375:x1875470043942400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788587968.786443:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14375:x1875470043942400:12345-0@lo:1000:mdt00_001.0 Request processed in 100us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587968.786450:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587968.786576:0:14375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4a67100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14375:1875470043942400:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788587968.787252:0:14375:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1788587968.787316:0:14375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5337b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14375:1875470043942528:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788587968.787355:0:14375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587968.787373:0:14375:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491138840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587968.788024:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043942528 00000100:00100000:0.0:1788587968.788031:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043942528 00000100:00100000:0.0:1788587968.788071:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587968.788079:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14375:x1875470043942528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788587968.788255:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14375:x1875470043942528:12345-0@lo:1000:mdt00_001.0 Request processed in 176us (899us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788587968.788262:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587968.788560:0:14375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5337b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14375:1875470043942528:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788587968.788596:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788605:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788612:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788626:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587968.788630:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788637:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788652:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88f49f9bab00) 00010000:00010000:3.0:1788587968.788655:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587968.788659:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788665:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4800/0xa13e120d54ca9923 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788772:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9882 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788780:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9882 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788786:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9882 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788791:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587968.788794:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9882 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788798:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9882 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788816:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:3.0:1788587968.788818:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587968.788824:0:14375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9889 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db163a expref: 18 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788835:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9889 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db163a expref: 18 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788871:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9889 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db163a expref: 18 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.788911:0:14375:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88f4856c0c00/0xa13e120d54ca9889 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db163a expref: 18 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587968.788925:0:14375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5335f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14375:1875470043942656:192.168.206.33@tcp:105: 00000100:00100000:3.0:1788587968.788985:0:14375:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491138840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587968.792811:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587968.792887:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026139392 00000100:00100000:0.0:1788587968.792896:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026139392 00000100:00100000:0.0:1788587968.792942:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:0.0:1788587968.792952:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf800850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+19:14453:x1875470026139392:12345-192.168.206.33@tcp:49:dd.0 00000100:00100000:3.0:1788587968.793172:0:14375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5335f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14375:1875470043942656:192.168.206.33@tcp:105: 00010000:00010000:3.0:1788587968.793198:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9882 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793207:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5a00/0xa13e120d54ca9882 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793236:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca992a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793248:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca992a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793274:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca992a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793284:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca992a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793290:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca992a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793297:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca992a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793302:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587968.793306:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca992a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793313:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca992a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793324:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:3.0:1788587968.793327:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587968.793331:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca992a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793337:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed4c00/0xa13e120d54ca992a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793347:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5c00/0xa13e120d54ca991c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793353:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5c00/0xa13e120d54ca991c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793366:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5c00/0xa13e120d54ca991c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793370:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788587968.793373:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5c00/0xa13e120d54ca991c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793390:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5c00/0xa13e120d54ca991c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793398:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88f489329d00) 00010000:00010000:3.0:1788587968.793401:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788587968.793403:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5c00/0xa13e120d54ca991c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.793408:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f4baed5c00/0xa13e120d54ca991c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587968.793712:0:14406:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788587968.793717:0:14406:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587968.793744:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788587968.793749:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788587968.794130:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf800850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+19:14453:x1875470026139392:12345-192.168.206.33@tcp:49:dd.0 Request processed in 1175us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587968.794140:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 10 00000100:00100000:3.0:1788587968.794238:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7adcb4d2-d264-45f5-9771-e68a1801e7d6+18:14455:x1875470026139136:12345-192.168.206.33@tcp:57:lhsmtool_posix.0 Request processed in 16911us (17127us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788587968.794247:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 53 00000020:00080000:3.0:1788587968.794251:0:14375:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788587968.799601:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587968.799678:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026139648 00000100:00100000:2.0:1788587968.799687:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026139648 00000100:00100000:2.0:1788587968.799798:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 11 00000100:00100000:2.0:1788587968.799809:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4baa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+18:14455:x1875470026139648:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788587968.802246:0:14377:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788587968.802372:0:14377:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788587968.802990:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9600/0xa13e120d54ca9931 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.803008:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9600/0xa13e120d54ca9931 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.803020:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9600/0xa13e120d54ca9931 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.803037:0:14377:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9600/0xa13e120d54ca9931 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.803044:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9600/0xa13e120d54ca9931 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.803050:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9600/0xa13e120d54ca9931 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.803074:0:14377:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788587968.803173:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4baa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+20:14455:x1875470026139648:12345-192.168.206.33@tcp:35:lhsmtool_posix.0 Request processed in 3362us (3576us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788587968.803183:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 11 00000020:00080000:2.0:1788587968.803189:0:14377:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788587968.803878:0:15852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587968.803896:0:15852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9600/0xa13e120d54ca9931 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.803905:0:15852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9600 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:0.0:1788587968.803909:0:15852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9600/0xa13e120d54ca9931 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.803919:0:15852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9600/0xa13e120d54ca9931 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.803933:0:15852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88f49f9bab00) 00010000:00010000:0.0:1788587968.803936:0:15852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788587968.803941:0:15852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9600/0xa13e120d54ca9931 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.803961:0:15852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88f485ce9600/0xa13e120d54ca9931 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.803974:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587968.803975:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587968.803977:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587968.922682:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587968.922891:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026139776 00000100:00100000:3.0:1788587968.922903:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026139776 00000100:00100000:3.0:1788587968.922987:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 0 00000100:00100000:3.0:1788587968.922999:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+8:2346:x1875470026139776:12345-192.168.206.33@tcp:4:dd.0 00010000:00010000:3.0:1788587968.923044:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c98b8600/0xa13e120d54ca9938 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.923087:0:15065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097538888/0xa13e120d54ca9907 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1664 expref: 8 pid: 15061 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.923096:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587968.923101:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587968.923107:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c98b8600/0xa13e120d54ca9938 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.923150:0:15065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097538888/0xa13e120d54ca9907 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1664 expref: 8 pid: 15061 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.923166:0:15065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097538888/0xa13e120d54ca9907 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1664 expref: 8 pid: 15061 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587968.923184:0:15065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5335f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15065:1875470043942784:192.168.206.33@tcp:104: 00000100:00100000:3.0:1788587968.923298:0:15065:0:(client.c:2716:ptlrpc_set_wait()) set ffff88f491138840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587968.925010:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:0.0:1788587968.925148:0:15067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587968.925277:0:15067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788587968.925667:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026139904 00000100:00100000:0.0:1788587968.925677:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026139904 00000100:00100000:3.0:1788587968.931092:0:16603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 1 00000100:00100000:3.0:1788587968.931111:0:16603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+9:2346:x1875470026139904:12345-192.168.206.33@tcp:4:dd.0 00010000:00010000:3.0:1788587968.931150:0:16603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca993f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.931169:0:16603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587968.931173:0:16603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587968.931184:0:16603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca993f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.931195:0:16603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca993f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587968.931823:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587968.931913:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:1.0:1788587968.931940:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026140160 00000100:00100000:1.0:1788587968.931947:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026140160 00000100:00100000:2.0:1788587968.932080:0:15067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788587968.932089:0:15067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1788587968.932218:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026140032 00000100:00100000:2.0:1788587968.932222:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026140032 00000100:00100000:3.0:1788587968.932461:0:15065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5335f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15065:1875470043942784:192.168.206.33@tcp:104: 00010000:00010000:3.0:1788587968.932484:0:15065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c98b8600/0xa13e120d54ca9938 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587968.932815:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 2 00000100:00100000:2.0:1788587968.932825:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7adcb4d2-d264-45f5-9771-e68a1801e7d6+11:2347:x1875470026140032:12345-192.168.206.33@tcp:4:dd.0 00010000:00010000:2.0:1788587968.932890:0:16604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc06c2a/0xa13e120d54ca9946 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.932905:0:16604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587968.932909:0:16604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587968.932913:0:16604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc06c2a/0xa13e120d54ca9946 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.932934:0:16604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fc06c2a/0xa13e120d54ca9946 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587968.933089:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097538888/0xa13e120d54ca9907 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1664 expref: 11 pid: 15061 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587968.933125:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 14 00000100:00100000:1.0:1788587968.933134:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+11:2344:x1875470026140160:12345-192.168.206.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587968.933147:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587968.933168:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097538888/0xa13e120d54ca9907 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1664 expref: 11 pid: 15061 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587968.933336:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097538888/0xa13e120d54ca9907 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1664 expref: 11 pid: 15061 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587968.933357:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097538888/0xa13e120d54ca9907 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.33@tcp remote: 0x718441a5e1db1664 expref: 11 pid: 15061 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587968.933370:0:14360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587968.933373:0:14360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587968.933442:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c98b8600/0xa13e120d54ca9938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587968.933454:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c98b8600/0xa13e120d54ca9938 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587968.933463:0:14360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587968.933473:0:14360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587968.933477:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca993f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587968.933484:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca993f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587968.933491:0:14360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587968.933494:0:14360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587968.933498:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fc06c2a/0xa13e120d54ca9946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587968.933506:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc06c2a/0xa13e120d54ca9946 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.933660:0:16604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fc06c2a/0xa13e120d54ca9946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587968.933670:0:16604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc06c2a/0xa13e120d54ca9946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587968.934363:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587968.934428:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+10:2344:x1875470026140160:12345-192.168.206.33@tcp:103:ldlm_bl.0 Request processed in 1293us (2512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587968.934437:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 14 00010000:00010000:0.0:1788587968.935198:0:15065:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c98b8600/0xa13e120d54ca9938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587968.935213:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c98b8600/0xa13e120d54ca9938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.935314:0:16603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca993f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587968.935325:0:16603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca993f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587969.016811:0:16604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1788587969.016821:0:16604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788587966 -> 1788587967 00002000:00010000:2.0:1788587969.016824:0:16604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1788587969.016838:0:16604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc06c2a/0xa13e120d54ca9946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.016890:0:16604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc06c2a/0xa13e120d54ca9946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.016899:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc06c2a/0xa13e120d54ca9946 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.016907:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce8a00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587969.016912:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc06c2a/0xa13e120d54ca9946 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.016940:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc06c2a/0xa13e120d54ca9946 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.016962:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc06c2a/0xa13e120d54ca9946 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.016971:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc06c2a/0xa13e120d54ca9946 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587969.017104:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7adcb4d2-d264-45f5-9771-e68a1801e7d6+17:2347:x1875470026140032:12345-192.168.206.33@tcp:4:dd.0 Request processed in 84276us (85278us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788587969.017115:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 2 00000001:00080000:2.0:1788587969.018150:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:2.0:1788587969.018166:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:2.0:1788587969.018177:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:1.0:1788587969.025466:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587969.025614:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026140288 00000100:00100000:3.0:1788587969.025624:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026140288 00000100:00100000:3.0:1788587969.025873:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 3 00000100:00100000:3.0:1788587969.025895:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+13:2346:x1875470026140288:12345-192.168.206.33@tcp:4:dd.0 00010000:00010000:3.0:1788587969.025928:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb71355/0xa13e120d54ca994d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587969.025944:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587969.025949:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587969.025955:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eb71355/0xa13e120d54ca994d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587969.025983:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eb71355/0xa13e120d54ca994d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788587969.026286:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587969.027560:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587969.027641:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587969.027665:0:15066:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1788587969.027672:0:15066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1788587969.027753:0:16604:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1788587969.027761:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026140416 00000100:00100000:3.0:1788587969.027768:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026140416 00000100:00100000:3.0:1788587969.027808:0:16604:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1788587969.027813:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026140544 00000100:00100000:3.0:1788587969.027816:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026140544 00000100:00100000:1.0:1788587969.036144:0:16607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 4 00000100:00100000:1.0:1788587969.036160:0:16607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7adcb4d2-d264-45f5-9771-e68a1801e7d6+16:2345:x1875470026140416:12345-192.168.206.33@tcp:4:dd.0 00010000:00010000:1.0:1788587969.036200:0:16607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053b09717/0xa13e120d54ca9954 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587969.036216:0:16607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587969.036226:0:16607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587969.036233:0:16607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053b09717/0xa13e120d54ca9954 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587969.036246:0:16607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053b09717/0xa13e120d54ca9954 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587969.131706:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1788587969.131738:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:3.0:1788587969.132147:0:16603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:3.0:1788587969.132153:0:16603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 6151 00010000:00010000:3.0:1788587969.132166:0:16603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca993f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587969.132178:0:16603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca993f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587969.132187:0:16603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca993f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587969.132193:0:16603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4c00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:3.0:1788587969.132198:0:16603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca993f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587969.132226:0:16603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca993f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587969.132245:0:16603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca993f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587969.132253:0:16603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca993f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587969.132334:0:16603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+16:2346:x1875470026139904:12345-192.168.206.33@tcp:4:dd.0 Request processed in 201225us (207329us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788587969.132344:0:16603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 1 00000100:00100000:3.0:1788587969.132373:0:16603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 5 00000100:00100000:3.0:1788587969.132384:0:16603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b5335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+15:2345:x1875470026140544:12345-192.168.206.33@tcp:4:dd.0 00010000:00010000:3.0:1788587969.132413:0:16603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002705b9a/0xa13e120d54ca995b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587969.132425:0:16603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587969.132429:0:16603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587969.132435:0:16603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002705b9a/0xa13e120d54ca995b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587969.132447:0:16603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002705b9a/0xa13e120d54ca995b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.132897:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c98b8600/0xa13e120d54ca9938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.132908:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c98b8600/0xa13e120d54ca9938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.132915:0:15065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c98b8600/0xa13e120d54ca9938 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.132921:0:15065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5c00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:0.0:1788587969.132925:0:15065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c98b8600/0xa13e120d54ca9938 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.132947:0:15065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c98b8600/0xa13e120d54ca9938 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.132961:0:15065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c98b8600/0xa13e120d54ca9938 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.132969:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c98b8600/0xa13e120d54ca9938 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587969.133013:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7adcb4d2-d264-45f5-9771-e68a1801e7d6+15:2346:x1875470026139776:12345-192.168.206.33@tcp:4:dd.0 Request processed in 210016us (210345us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788587969.133020:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 0 00000001:00080000:2.0:1788587969.194900:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:0.0:1788587969.194981:0:16607:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1788587969.194991:0:16607:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:0.0:1788587969.195006:0:16607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053b09717/0xa13e120d54ca9954 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.195018:0:16607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053b09717/0xa13e120d54ca9954 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.195028:0:16607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053b09717/0xa13e120d54ca9954 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.195035:0:16607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4856c1400 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:0.0:1788587969.195040:0:16607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053b09717/0xa13e120d54ca9954 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.195061:0:16607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053b09717/0xa13e120d54ca9954 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.195080:0:16607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053b09717/0xa13e120d54ca9954 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.195088:0:16607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053b09717/0xa13e120d54ca9954 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587969.195186:0:16607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7adcb4d2-d264-45f5-9771-e68a1801e7d6+11:2345:x1875470026140416:12345-192.168.206.33@tcp:4:dd.0 Request processed in 159025us (167627us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788587969.195195:0:16607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 4 00010000:00010000:0.0:1788587969.195238:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb71355/0xa13e120d54ca994d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.195248:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eb71355/0xa13e120d54ca994d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.195255:0:15067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eb71355/0xa13e120d54ca994d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.195262:0:15067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed5a00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:0.0:1788587969.195266:0:15067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb71355/0xa13e120d54ca994d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.195285:0:15067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb71355/0xa13e120d54ca994d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.195296:0:15067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eb71355/0xa13e120d54ca994d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587969.195304:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eb71355/0xa13e120d54ca994d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587969.195359:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7adcb4d2-d264-45f5-9771-e68a1801e7d6+9:2346:x1875470026140288:12345-192.168.206.33@tcp:4:dd.0 Request processed in 169476us (169899us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788587969.195367:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 3 00002000:00010000:2.0:1788587969.233461:0:16603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:2.0:1788587969.233492:0:16603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002705b9a/0xa13e120d54ca995b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.233506:0:16603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002705b9a/0xa13e120d54ca995b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.233515:0:16603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002705b9a/0xa13e120d54ca995b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.233533:0:16603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4600 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587969.233539:0:16603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002705b9a/0xa13e120d54ca995b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.233548:0:16603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002705b9a/0xa13e120d54ca995b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.233566:0:16603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002705b9a/0xa13e120d54ca995b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.233574:0:16603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002705b9a/0xa13e120d54ca995b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587969.233660:0:16603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b5335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7adcb4d2-d264-45f5-9771-e68a1801e7d6+7:2345:x1875470026140544:12345-192.168.206.33@tcp:4:dd.0 Request processed in 101275us (206014us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788587969.233669:0:16603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 5 00000001:00080000:2.0:1788587969.233713:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00010000:00010000:3.0:1788587969.236642:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587969.239982:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:2.0:1788587969.240020:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.33@tcp (source: 12345-192.168.206.33@tcp) 00000100:00100000:3.0:1788587969.240096:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026140672 00000100:00100000:3.0:1788587969.240105:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026140672 00000100:00100000:3.0:1788587969.240165:0:16604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470026140800 00000100:00100000:3.0:1788587969.240169:0:16604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470026140800 00000100:00100000:3.0:1788587969.240201:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 6 00000100:00100000:3.0:1788587969.240210:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7adcb4d2-d264-45f5-9771-e68a1801e7d6+6:2345:x1875470026140672:12345-192.168.206.33@tcp:4:dd.0 00002000:00010000:3.0:1788587969.240256:0:16604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 6291456, mtime: 0x6a9bafbf, atime: 0x6a9bafbe, ctime: 0x0, blocks: 0x3007 00010000:00010000:3.0:1788587969.240265:0:16604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca9962 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587969.240280:0:16604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1788587969.240284:0:16604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587969.240291:0:16604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca9962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587969.240305:0:16604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca9962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587969.240601:0:16607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.33@tcp, seq: 7 00000100:00100000:2.0:1788587969.240612:0:16607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7adcb4d2-d264-45f5-9771-e68a1801e7d6+7:2344:x1875470026140800:12345-192.168.206.33@tcp:4:dd.0 00010000:00010000:2.0:1788587969.240630:0:16607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9969 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.240640:0:16607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587969.240655:0:16607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587969.240660:0:16607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.240670:0:16607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587969.296969:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:2.0:1788587969.297433:0:16604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:2.0:1788587969.297438:0:16604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788587967 -> 1788587968 00002000:00010000:2.0:1788587969.297441:0:16604:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788587968 00002000:00010000:2.0:1788587969.297443:0:16604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1788587969.297457:0:16604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca9962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.297470:0:16604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca9962 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.297478:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca9962 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.297486:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f4baed4c00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587969.297491:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca9962 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.297500:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca9962 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.297518:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca9962 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.297538:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d9812c5/0xa13e120d54ca9962 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587969.297622:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7adcb4d2-d264-45f5-9771-e68a1801e7d6+9:2345:x1875470026140672:12345-192.168.206.33@tcp:4:dd.0 Request processed in 57408us (57644us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788587969.297632:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 6 00000001:00080000:1.0:1788587969.342948:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:2.0:1788587969.343271:0:16607:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1788587969.343288:0:16607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.343301:0:16607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.343310:0:16607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9969 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.343330:0:16607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88f485ce9e00 already unused, calling callback (ffffffffc17664f0) 00010000:00010000:2.0:1788587969.343336:0:16607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9969 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.343346:0:16607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9969 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.343366:0:16607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9969 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587969.343401:0:16607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef2dff69/0xa13e120d54ca9969 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587969.343512:0:16607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7adcb4d2-d264-45f5-9771-e68a1801e7d6+5:2344:x1875470026140800:12345-192.168.206.33@tcp:4:dd.0 Request processed in 102898us (103486us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788587969.343522:0:16607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.33@tcp, seq: 7 00010000:00010000:3.0:1788587970.248182:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587970.933433:0:16645:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788587971.272075:0:15852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587972.040027:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587972.040067:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4af3e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043942912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587972.040117:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043943552:0@lo:400:kworker.0 00000100:00100000:1.0:1788587972.040165:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587972.040175:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587972.040236:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043942912 00000100:00100000:1.0:1788587972.040246:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:475e03e7-2028-419a-a63d-caf8ec05d538:3303:1875470043943168:0@lo:400:kworker.0 00000100:00100000:3.0:1788587972.040247:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043942912 00000100:00100000:3.0:1788587972.040321:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587972.040331:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043942912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587972.040376:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 64684032 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788587972.043125:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b5334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043943040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587972.043206:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587972.043228:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043943424:0@lo:400:kworker.0 00000100:00100000:2.0:1788587972.043255:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587972.043282:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788587972.043288:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4b4a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043943296:0@lo:400:kworker.0 00000100:00100000:2.0:1788587972.043313:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587972.043330:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043943808:0@lo:400:kworker.0 00000100:00100000:2.0:1788587972.043357:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587972.043410:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043943552 00000100:00100000:2.0:1788587972.043420:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043943552 00000100:00100000:2.0:1788587972.043475:0:16601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043943808 00000100:00100000:2.0:1788587972.043478:0:16601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043943808 00000100:00100000:2.0:1788587972.043509:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788587972.043520:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043943552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587972.043571:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587972.043596:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875470043943552:12345-0@lo:400:kworker.0 Request processed in 76us (3420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587972.043613:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788587972.043622:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88f4bf727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043943680:0@lo:400:kworker.0 00000100:00100000:2.0:1788587972.043654:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587972.043661:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043943808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587972.043694:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875470043943808:12345-0@lo:400:kworker.0 Request processed in 35us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587972.043700:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587972.043740:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043943424 00000100:00100000:2.0:1788587972.043744:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043943424 00000100:00100000:2.0:1788587972.043775:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043943296 00000100:00100000:2.0:1788587972.043779:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043943296 00000100:00100000:2.0:1788587972.043802:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587972.043808:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875470043943424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587972.043859:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875470043943424:12345-0@lo:400:kworker.0 Request processed in 33us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587972.043877:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587972.043894:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587972.043905:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043943296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587972.043907:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587972.043947:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043943296:12345-0@lo:400:kworker.0 Request processed in 47us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587972.043953:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788587972.043957:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587972.043964:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587972.043967:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587972.043984:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788587972.043985:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043943680 00000100:00100000:2.0:1788587972.043991:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043943680 00000100:00100000:1.0:1788587972.043997:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788587972.044020:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043943168 00000100:00100000:1.0:1788587972.044025:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043943168 00000100:00100000:2.0:1788587972.044029:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788587972.044038:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4af3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043943680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587972.044079:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875470043943680:12345-0@lo:400:kworker.0 Request processed in 43us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587972.044097:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587972.044154:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4af3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875470043942912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3810us (3976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587972.044172:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587972.044191:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875470043943040 00000100:00100000:3.0:1788587972.044195:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875470043943040 00000100:00100000:3.0:1788587972.044213:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587972.044219:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4bf725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043943040:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788587972.044227:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:3.0:1788587972.044255:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587972.044266:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875470043943552:0@lo:400:kworker.0 00000100:00100000:3.0:1788587972.044294:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4bf725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875470043943040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587972.044303:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587972.044318:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043943296:0@lo:400:kworker.0 00000100:00100000:2.0:1788587972.044332:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875470043943808:0@lo:400:kworker.0 00000100:00100000:2.0:1788587972.044349:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b5334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043943040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587972.044359:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788587972.044365:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88f4baa50000, transno 8589934595 00000004:00080000:2.0:1788587972.044390:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788587972.044409:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875470043943424:0@lo:400:kworker.0 00000100:00100000:1.0:1788587972.045235:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788587972.045251:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88f4b484d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+19:3303:x1875470043943168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587972.045314:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88f4b484d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:475e03e7-2028-419a-a63d-caf8ec05d538+19:3303:x1875470043943168:12345-0@lo:400:kworker.0 Request processed in 70us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587972.045332:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788587972.048301:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4b4a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:475e03e7-2028-419a-a63d-caf8ec05d538:3303:1875470043943168:0@lo:400:kworker.0 00000100:00100000:1.0:1788587972.048332:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4bf727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875470043943680:0@lo:400:kworker.0 00000100:00100000:1.0:1788587972.048363:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88f4af3e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875470043942912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788587972.296474:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28727 lines, 28727 kept, 0 dropped, 0 bad.